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"The  school  survey  is  a  new  and  distinctive  implement  of  jirogress. 
It  has  come  into  being  for  the  purpose  of  educating  the  public  about  their 
schools,  and  its  distinctive  function  should  be  preserved.  It  is  a  part  of  our 
national  self-examination.  It  is  the  product  of  civic  intelligence  and  com- 
munity progress. 

"Its  object  is  to  make  the  entire  school  system  pass  in  review  before 
the  public  eye.  It  makes  the  schools  and  the  public  pay  attention  to  each 
other.  It  presents  the  past,  the  present,  and  the  possible.  It  is  a  commimity 
stocktaking  inventory,  and  appraisal  of  its  educational  assets  and  oppor- 
tunities. It  aims  to  place  before  the  citizens  a  picture  of  their  schools;  a 
picture  so  accurate  that  it  cannot  mislead;  so  simple  that  it  cannot  be  mis- 
understood, and  so  significant  that  it  cannot  be  disregarded.  It  does  not 
always  succeed  in  its  aim,  but  it  cannot  even  take  aim  in  secret  or  in  the 
dark." — L.  P.  Ayres,  in  Proceedings  of  Indiana  University  Conference  on 
Educational  Measurements,  1915. 
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Foreword 


The  third  annual  conference  on  educational  measurements 
at  Indiana  University  has  continued  in  part  the  lines  of  discussion 
inaugurated  in  the  first  two  conferences  relative  to  the  measure- 
ment of  achievement  in  certain  school  subjects.  Dr.  Thorn- 
dike's  discussions  and  demonstrations  of  the  measurement  of 
reading  ability  at  the  first  conference  stimulated  investigation 
along  this  line  by  the  Bureau  of  Research,  under  Dr.  Melvin  E. 
Haggerty's  direction,  the  report  of  which  is  now  being  published 
by  the  University. 

The  study  on  the  measurement  of  arithmetical  abilities, 
published  early  in  1915  by  Dr.  Haggerty,  and  the  discussions  by 
Mr.  Courtis  at  the  second  conference  have  stimulated  further 
measurement  and  experimentation  in  arithmetic  during  the  year, 
the  results  of  which  are  now  in  press. 

Cooperative  investigations  were  reported  at  the  third  con- 
ference by  Associate  Prof(\ssor  Hubert  G.  Childs  on  the  cost  of 
instruction  in  Indiana  high  schools,  measurement  of  achieve- 
ment in  algebra,  acceleration  and  retardation  in  certain  Indiana 
high  schools,  and  failures  in  high  schools  by  years  and  subjects. 

An  investigation  of  handwriting  has  been  undertaken  by 
Professor  William  W.  Black  and  formed  the  topic  for  a  pre- 
liminary report  at  the  conference. 

An  important  feature  of  the  conference  was  a  practical  demon- 
stration in  the  administration  of  tests  in  the  Bloomington  schools 
under  the  direction  of  members  of  the  faculty  of  the  University 
School  of  Education.  Such  tests  were  conducted  in  algebra, 
arithmetic,  English  composition,  and  reading.  The  test  papers 
were  scored  by  those  visiting  the  demonstrations,  and  the  results 
were  tabulated  and  interpreted  in  their  presence  immediately 
following  the  demonstration. 

The  addresses  and  discussions  conducted  by  Doctors  Cub- 
berley  and  Buckingham  were  centered  around  the  general  topics 
of  the  significance  of  educational  measurements  in  school  adminis- 
tration and  the  construction  and  application  of  standard  scales 
of  measurement  in  school  subjects. 

Before  adjournment  the  conference  expressed  its  appreciation 
of  the  service  rendered  by  the  University  in  promoting  these 
conferences,  and  requested  that  they  be  continued. 
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Introductory  Address 


William  Lowe  Bryan,  President  of  Indiana  Universitj- 


When  new  ideas  are  presented,  the  most  important  thing  is 
not  to  agree  with  them,  or  to  oppose  them,  but  to  understand 
them.  Every  new  movement  in  education  in  America  is  Ukely 
to  represent  some  fundamental  idea,  but  every  such  movement 
is  met  by  the  opposition  of  those  who  do  not  understand  it, 
and  is  advocated  on  all  sides  by  those  who  do  not  understand 
it.  Every  new  educational  movement  is,  therefore,  on  the  surface 
a  superficial  fad.  Thousands  of  people  are  crying  it  up  and 
declaring  that  now  at  last  we  have  solved  the  pro])lem  of  educa- 
tion, when,  in  fact,  they  have  no  real  grasp  of  the  movement 
which  they  favor.  On  the  other  hand,  every  such  movement  is 
opi)osed  by  men  who  feel  affronted  because  something  has  come 
up  in  which  they  play  no  part.  If  one  looks  only  at  the  surface, 
the  history  of  American  education  is  a  history  of  summer  cyclones 
blowing  about  full  of  noise  and  dust  until  presently  they  disappear. 
In  truth,  however,  each  of  these  movements  arises  because  some 
persons  have  seen  deeply  a  certain  need  and  a  certain  way  of 
bettering  existing  conditions.  My  appeal  to  young  people  who 
have  entered  the  field  of  education  is  not  that  they  shall  favor 
and  not  that  they  shall  oppose  current  educational  movements, 
but  that  they  shall  strive  earnestly  to  be  of  those  who  compre- 
hend the  deeper  currents  of  our  educational  \ii<\ 
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The  Significance  of  Educational  Measurements 


Ellwood  p.  Cubrerley,  Professor  of  Education,  Lclaiid  Slanford  Junior 

University 


It  is  iii(l(XHl  a  pleasure  to  me  to  come  back  to  th(^  old  Univer- 
sity, tho  it  doesn't  seem  quite  like  the  old  place.  In  my  day  we 
had  a-  few  students  and  a  few  buiklings  and  much  faith  and  en- 
thusiasm. Now  I  understand  you  have  many  students,  many 
buildings,  and  many  times  the  amount  of  faith  and  hope  and 
enthusiasm  that  they  had  in  the  days  when  I  was  a  young  man 
here.  It  is  an  especial  pleasure  to  com(;  back  and  find  some  of  my 
old  friends  still  here. 

I  feel  somewhat  diffident  in  coming  to  this  institution,  how- 
ever, to  talk  to  you  on  the  question  of  educational  measurements 
and  the  significance  of  the  movement.  In  an  institution  which 
has  done  so  much  in  the  line  of  congresses  on  educational  measure- 
ments, and  where  so  many  publications  have  been  issued  which 
set  forth  the  work  and  the  value  and  the  significance  of  it  all, 
I  f(»el  a  little  as  tho  I  were  carrying  coals  to  Newcastle  in  conung 
to  talk  to  you  on  the  subject.  Yet,  if  you  will  permit  me,  I  should 
like  to  gather  up  what  seems  to  me  to  be  some  of  the  moi'e  signi- 
ficant featiii-es  of  this  new  movement  and  present  them  to  you 
this  evening. 

I  say  a  new  movement.  It  is  essentially  a  new  on(^  A  decade 
will  practically  measure  almost  all  the  work  which  has  been  done 
in  the  line  of  school  tests,  the  formulation  of  standardis  of  measure- 
ment, and  the  attempt  to  evolve  units  of  accomplishment.  A 
decade  hence  I  think  no  school  man  who  assumes  to  be  an  expert 
in  administration  can  expect  to  have  any  hearing  in  the  educa- 
tional world  unless  he  is  quite  familiar  with  the  work  of  testing, 
and  with  the  units  of  accomplishment  which  will,  by  that  time, 
have  been  formulated.  He  must  also  be  able  to  apply  such 
tests  and  standards  in  the  school  system  in  which  h,e  is  trying 
to  render  service. 

I  say  the  movement  is  new.  It  is  as  yet  in  its  infancy.  We 
hardly  realize  ourselves,   I  think,  we  who  have  been  most  in- 
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tercsted  in  this  Icsliiij);  work,  tlie  vast  significsmcc  of  Hiis  iiiovo- 
ment  for  our  j)rof('ssi()n.  It  means  the  making  of  a  i)rofcssion  of 
school  administration,  instead  of  the  mere  joli  of  running  a  school 
system.  It  means  the  dignifying  of  our  calling;  it  means  the 
placing  of  the  profession  on  a  scientific  basis;  and  the  far-reaching 
significance  of  that  can  scarcely  be  overestimated.  We  are  now 
attempting  to  do  in  school  work  what  has  been  done  for  some 
time  in  the  business  world. 

Any  business  man  who  is  managing  a  business  in  which  he 
expects  to  make  profits  wall  have  standards  from  which  he  will 
work.  He  will  have  measuring  sticks  to  test  the  efficiency  of 
his  output;  he  will  have  units  of  accomplishment;  he  will  have 
cost  accounting  systems;  and  he  will  have  standards  of  many 
kinds.  He  will  also  have  a  continual  system  of  testing  and 
working  over  what  he  is  doing,  to  find  out  whether  what  he 
is  doing  is  the  best  that  can  be  done  with  the  money  he  has 
at  hand,  and  whether  the  output  is  as  large  as  he  could  well 
produce  with  the  work  and  the  money  he  has  to  invest  in  it. 

In  the  business  world  the  business  man  is  continually  facing 
the  question  of  justifying  his  work  to  his  stockholders.  The 
stockholders  demand  profits;  they  want  to  know  whether  the 
business  is  being  efficiently  managed;  and  if  the  work  is  not 
being  efficiently  managed,  as  determined  by  the  percentage  of 
profit  on  the  common  stock,  they  demand  that  there  shall  be 
some  reasons  given  to  them  why  it  is  not  paying,  or  else  that 
there  shall  be  a  change  in  the  management  of  the  enterprise. 

In  the  school  business  we  have  a  State  monopoly,  in  which 
there  is  almost  no  accounting.  We  have  been  very  content  to 
compel  children  to  come  to  the  school  system,  and  then  outline 
a  course  of  study  for  them  which  we  felt  to  be  good,  but  which 
very  often  was  based  on  past  conditions  rather  than  on  future 
needs.  After  giving  such  instruction  to  our  children,  we  have 
been  satisfied  to  test  them  by  means  of  an  examination,  and 
(o  trust  to  the  growth  process  to  bring  out  the  kind  of  develop- 
ment we  hoped  for.  It  has  been  very  analogous  to  the  old  chance 
and  luck  farming,  where  the  farmer  looked  at  the  moon,  guessed 
at  the  weather,  put  in  his  crops,  and  prayed  to  the  Lord  to  help 
him  thru  the  season.  Today  he  may  do  all  of  those  things,  but 
in  addition  he  applies  to  his  work  some  science;  he  b(>gins  to  find 
out  various  things  which  he  needs  to  know;  and  he  introduces  a 
niitid)er  of  scientific  factors  into  his  work.  These  have  tended 
to  eliminate  the  luck  and   chance  farming  of  the  past,   and   to 
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iiilrodiu'c  into  the  woi'k  of  faniiin<j!;  a  large  amount  oi'  scientific; 
efficiency. 

A  nianufacturer  will  have  specifications.  He  knows  what 
h(^  is  trying  to  do,  and  he  draws  up  his  specifications  according 
to  the  needs  of  the  market  he  is  trying  to  meet.  He  has  a  careful 
system  of  accounting;  he  knows  what  it  costs  to  produce  each 
part  of  his  manufactured  output;  he  knows  how  much  of  his 
output  is  efficiently  manufactured,  and  how  nuich  raw  material 
goes  to  waste  or  to  the  dump  pile;  and  he  is  continually  studying 
methods  to  try  to  reduce  such  waste,  and  make  some  new  profit 
out  of  it.  He  is  continually  keeping  books  on  all  stages  of  the 
process;  he  is  continually  testing  each  phase  of  the  manufacturing 
as  it  goes  along,  and  rejecting  all  unsatisfactory  output;  and  he 
is  continually  trying  to  find  means  for  improving  those  parts  of 
the  manufacturing  process  which  are  wasteful  or  unsatisfactory. 
His  object  is  to  secure  a  more  satisfactory  output,  so  that  there 
will  be  larger  profits  for  the  business.  I  suppose  the  automobile 
business  offers  us  one  of  the  most  easily  seen  analogies,  and  one 
that  we  can  appreciate  best.  In  this  a  thoro  system  of  accounting 
and  testing  characterizes  all  stages  of  the  process  of  manufacturing. 
Costs  are  figured  on  every  item  of  the  manufacturing  process; 
the  producer  knows  how  much  his  leather  costs,  how  much  his 
bodies  are  costing;  how  much  his  castings  are  costing;  how  much 
bearings  are  costing;  and  so  on  for  every  phase  of  the  manufac- 
turing process.  He  is  also  continually  studying  his  market 
conditions.  He  is  tr^ying  to  adapt  his  product  to  new  needs; 
he  is  trying  to  find  new  markets;  he  is  trying  to  find  in  advance 
what  people  want;  and  he  is  changing  his  specifications  contin- 
ually to  meet  the  new  conditions  he  is  facing.  The  systematized 
way  in  which  this  business  is  managed  would  rather  astonish 
the  ordinary  school  man.  What  is  true  of  the  automobile  business 
is  true  of  almost  every  other  successful  large  business. 

In  our  school  work  very  often  we  have  nothing  of  that  kind. 
Our  specifications  are  not  always  dictated  by  the  needs  of  the 
future;  too  often  they  are  framed  by  those  who  are  thinking 
in  terms  of  the  past.  We  have  no  unit-cost  accounting  systems; 
we  do  not  continually  measure  the  output.  An  age  and  grade 
distribution  sheet  for  almost  any  school  system  would  show  a 
very  large  amount  of  waste  in  the  process  of  manufacture. 

In  farming,  up  to  a  very  short  time  ago,  the  manufacturing 
process  went  along  in  a  very  unsatisfactory  manner.  Some  farmers 
still  manage  their  farms  in  that  way  today,  but  the  farmer  who 
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is  efficient,  the  farmer  who  is  making  his  farm  pay,  is  now  a 
farmer  who  knows  what  everything  on  his  farm  is  costing;  whether 
his  cows  are  paying  their  board  and  keep;  whether  the  pigs  are 
jKiying  enough  in  profits  to  warrant  retaining  them;  whether  or 
not  he  can  raise  wheat  at  a  profit  when  it  sells  for  a  dollar  a  bushel; 
whether  horses  are  more  economical  than  machinery  for  certain 
parts  of  the  farming  work;  and  the  amount  of  saving  that  can 
l)e  made  on  this  or  that  or  the  other  thing  that  he  does  on  the 
farm.  In  fact,  a  modern  farmer  has  a  long  series  of  bookkeeping 
accounts,  and  out  of  such  he  can  tell  whether  he  would  better 
sell  any  cow  to  the  butcher  or  keep  her;  whether  he  would  better 
quit  raising  pigs,  etc. 

To  return  to  the  school,  we  find  many  new  demands,  and  new 
conditions  facing  us.  There  was  a  time,  a  very  short  time  ago, 
when  in  most  of  our  cities  the  city  council  tended  to  divide  the 
money  derived  from  taxation  rather  evenly  between  the  schools 
on  the  one  hand  and  the  other  branches  of  the  cit}^  government 
on  the  other.  That  day  has  passed,  and  probably  passed  forever, 
and  we  can  look  forward,  as  city  superintendents  of  schools,  to 
an  increasing  struggle  in  the  cities  in  which  we  are  working  to  be 
able  to  retain  for  the  schools  a  proper  percentage  of  city  funds. 
Why?  Partly  because  of  the  increase  in  cost  of  everything,  with 
every  city  finding  that  it  must  increase  its  budget  in  order  to 
meet  these  increasing  costs;  partly,  also,  because  in  many  of 
our  cities  the  question  of  what  results  are  being  obtained  from 
the  money  expended  is  being  faced  by  all  departments,  and  the 
school  department  is  one  of  those  which  can  answer  least  satis- 
factorily. 

As  a  recent  writer  has  said,  why  should  New  York  City,  for 
example,  be  spending  more  money  on  inefficient  teachers,  rather 
than  on  efficient  sul)ways?  Why  should  it  build  more  schools 
instead  of  doing  more  for  the  sanitary  conditions  of  the  city? 
Why  should  it  provide  better  pay  for  school  janitors,  rather  than 
provide  for  more  milk  inspectors?  Why  should  it  try  to  do  more 
for  children  in  lines  of  education,  rather  than  improve  the  milk 
supply  and  save  the  city's  babies? 

In  almost  all  the  lines  of  work  mentioned  it  is  possible  to 
put  before  a  city  council  perfectly  definite  facts;  that  is,  so  much 
money  spent  upon  the  protection  of  the  milk  suppl}'  meant 
a  reduction  of  so  much  in  the  death-rate  of  children  last  summer; 
so  much  spent  upon  sanitary  conditions  meant  an  equal  decrease 
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in  the  sickness  rate  and  death-rate.  The  school  man  ahnost  alone 
has  been  without  such  figures. 

A^ain,  the  increase  in  the  cost  of  everything  is  going  to  make 
us  look,  with  greater  care,  upon  our  (expenditures.  Are  we  spend- 
ing our  money  well?  Are  we  not  spending  much  money  in  un- 
necessary duplications?  Are  we  not  indulging  in  a  large  number 
of  very  costly  luxuries?  Are  we  doing  the  best  we  can  with  the 
money  we  have  at  hand?  Now  to  know  those  things  involves 
some  system  of  accounting,  of  a  type  which  we  have  not  as  yet 
introduced,  at  least  to  any  extent,  into  our  school  systems. 

Up  to  a  very  short  time  ago  our  chief  method  of  measuring 
a  school  system  was  the  method  of  personal  opinion.  You 
go  into  the  school  system  of  Superintendent  Jones  and  look  it 
over  and  say  it  is  quite  poor;  I  go  in  and  I  say  it  is  quite  ])oor, 
too.  We  both  agree;  therefore  it  must  be  poor.  On  the  other 
hand,  I  go  in  and  say  I  don't  think  it  is  poor;  it  has  some  weak 
points,  to  be  sure,  but  I  think  it  is  very  good.  Now  it  becomes 
a  question  of  your  opinion  against  mine,  and  mine  against  yours, 
and  people  will  believe  whichever  side  they  happen  to  favor, 
or  whether  they  know  you  or  know  me.  Such  a  method  of  esti- 
mating by  personal  opinion  will  never  get  us  very  far. 

Within  the  last  decade  or  so  we  have  introduced  another 
method  which  has  much  more  promise — the  method  of  comparison. 
By  this  we  take  the  different  cities  of  the  same  class  in  size,  chil- 
dren in  school,  wealth,  and  so  on,  and  compare  them  upon  a  dozen 
or  twenty  different  items.  After  making  such  a  comparison  you 
say  thay  a  city  stands  sixteenth  out  of  20  from  the  top  in  this 
item;  it  stands  seventeenth  in  this  one;  in  stands  twelfth  in  this 
item,  and  so  on. 

This  is  very  nmch  better  than  the  method  of  personal  oi)inion, 
but  it  is  defective  in  that  you  are  continuall}^  comparing  with 
the  average  of  a  kind.  The  average  has  the  defect  that  you  are 
continually  measuring  yourself  against  mediocrity;  you  are  striking 
the  average,  or  the  median,  and  you  are  finding  out  where  you 
are  with  reference  to  this  average  or  median,  and  in  a  series  of, 
let  us  say,  20  schools,  the  average  or  median  may  not  represent 
a  good  system  at  all.  Perhaps  all  below  the  average  or  median 
are  poor,  and  perhaps  even  a  portion  of  those  above  are  not 
doing  what  they  should  to  be  progressing.  The  real  progressive 
cities  are  in  the  upper  portion  of  the  group,  and  it  is  there  that 
you  should  measure  yourself,  rather  than  by  the  average  of  the 
lot. 
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The  third  niotliod.  to  which  we  are  coming,  is  a  method  of 
setting  up  standard  measurements  and  units  of  accomphshment 
for  the  measurement  of  the  work  of  our  schools.  This  whole 
movement  has  been  evolved  very  recently.  Perhaps  a  decade, 
as  I  said  a  moment  ago,  covers  it  all.  We  began  with  writing 
tests  and  spelling  tests.  Then  we  evolved  a  composition  test. 
Next  we  secured  arithmetic  tests — tests  for  the  fundamentals, 
and  tests  for  the  reasoning  side.  Then  came  drawing  tests,  reading 
tests,  and  so  on.  Today  tests  in  almost  all  of  our  elementary 
and  in  many  of  our  high  school  subjects  arc  being  evolved. 

In  addition  to  these  we  are  beginning  to  get  standards  for 
measuring  teaching  efficiency.  We  are  also  getting  a  reliable 
scale  for  measuring  the  intelligence  of  children.  We  are  getting 
very  good  measures  of  retardation;  we  arc  beginning  to  set  up 
standards  of  the  usefulness  of  the  school  subjects  which  we  are 
teaching;  and  we  are  beginning  to  get  standards  for  cost  account- 
ing, not  only  for  subjects,  but  for  schools,  buildings,  fuel,  janitor 
service,  etc. 

Tn  other  words,  we  are  beginning  to  measure  not  only  the 
outi)ut  of  our  factory,  but  the  cost  of  the  output  as  well.  In 
the  evolution  of  those  standards  we  are,  I  think,  making  progress 
along  the  lines  which  the  business  man  has  found  so  useful  and  so 
efticient.  We  arc  also  beginning  not  only  to  get  tests  ])y  means  of 
which  we  can  go  in  and  test  up  and  sec  where  a  school  stands, 
but  we  are  beginning  to  evolve  some  units  of  accomplishment,  and 
units  of  accomplishment  naturally  come  as  a  corollary  to  the 
tests  themselves.  By  tabulating  the  results  from  a  large  number 
of  school  systems  we  begin  to  find  out  what  is  about  the  average 
for  a  school  system.  By  applying  the  tests  to  people  in  life  out- 
side we  try  to  find  the  needs  of  common  life  in  terms  of  these 
tests,  and  out  of  such  study  to  evolve  in  time  a  series  of  units 
of  accomplishment, — a  series  of  standards  for  work  of  the  differ- 
ent grades  which  will  enable  us  to  say  that  we  have  done,  or  that 
we  have  not  done,  what  might  reasonably  be  expected  of  us 
for  the  children  in  the  eighth  grade,  or  the  seventh  grade,  or  the 
sixth  grade,  or  wherever  we  may  desire  to  question  school 
accomplishments. 

For  example,  in  spelling  we  have  now  evolved  rather  reason- 
able and  fair  standards  by  which  to  measure  a  school  system, 
and  now  we  arc  in  turn  beginning  to  evolve  better  spelling  books, 
worlccd  out  on  a  much  more  rational  basis.  Many  of  our  spelling 
books  have  run  as  high  as  8,000  to  10,000  words,  whereas  we 
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arc  finding  wc  don't  need  any  such  niiml)er  at  all,  and  that  perhaps 
3,000  or  3,500  words  would  ])e  sufficient  to  teach  the  children 
in  all  of  their  eight  years  of  the  elementary  school  courses. 

A  series  of  spelling  studies  has  been  made  in  various  parts 
of  the  country,  and  these  have  been  tabulated  recently.  A 
series  of  investigations  has  been  made  of  business  men's  letters; 
a  series  of  investigations  has  been  made  of  the  letters  which 
farmers  write  to  the  agricultural  colleges,  and  various  other 
types  of  spelling  investigations  have  l)een  made,  and  when  all 
have  been  compiled  and  put  together,  the  surprising  thing  is 
that  the  number  of  words  which  occur  two  times  or  three  times 
is  I'elatively  small — less  than  4,000  in  all — and  those  approximately 
4,000  are  now  being  compiled  into  a  spelling  book  which  will 
represent  what  we  might  call  tiie  maximum  for  the  work  of 
our  elementary  schools. 

Again,  in  writing,  tlu'u  the  Ayers  and  Thorndike  scales  we 
have  evolved  something  of  a  standard  of  what  a  child  ought  to 
do.  We  feel  fairly  well  satisfied  that  a  child  of  the  fifth  grade 
ought  to  be  somewhere  between  11  and  12;  in  the  sixth,  some- 
where near  12|  or  13;  and  so  on  with  the  different  grades,  and 
the  children  can  measure  their  own  writing  by  such  scales  if 
they  wish  to  do  so. 

In  arithmetic  also  we  are  beginning  to  get  some  standards  of 
accuracy  and  some  standards  for  speed.  In  a  recent  investigation, 
published  in  the  last  "Yearbook  of  the  National  Society  for  the 
Study  of  Education",  Mr.  Courtis  tells  of  a  small  investigation 
which  he  made  with  a  number  of  clerks  in  the  Wanamaker  store 
in  New  York.  He  was  trying  to  find  out  what  was  the  standard 
of  accuracy  demanded  by  the  work  in  the  Wanamaker  store. 
After  we  have  greatly  multijilied  such  investigations,  and  have 
combined  the  results,  we  can  begin  to  say  what  are  the  standards 
■of  actual  lousiness  life  which  wv  in  the  schools  ought  to  l)e  meet- 
ing. 

Now  perhaps  I  can  best  point  out  to  you  the  significance 
of  all  of  this  by  telling  you  a  rather  interesting  story  of  the  schools 
of  Salt  T^ake  City.  I  was  recently  asked  to  direct  the  work  of  a 
school  survey  there.  One  of  the  actuating  motives  for  that  sur- 
vey was  the  persistent  complaint  of  the  business  men  of  Salt  Lake 
Cit}^  that  the  children  could  not  write;  that  they  could  not  spell; 
that  they  could  not  cipher;  that  they  could  not  read;  and  that  they 
could  not  compose.  That  complaint  had  been  so  persistent 
and  had  been  made  for  so  long  that  the  schools  had  gradually 
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come  to  emphasize  reading  and  writino;  and  composition  and 
arithmetic  out  of  all  pi'oportion  to  tlunr  relative  merits.  The 
time  allowed  for  all  of  those  subjects  had  been  gradually  pushed 
up,  more  words  had  been  put  in  to  be  spelled,  more  problems 
to  be  solved,  and  more  composition  work  to  be  done.  As  a  result, 
when  the  schools  were  measured  and  compared  with  other  cities 
in  the  United  States,  Salt  Lake  City  stood  nearly  at  the  top. 
Their  spelling  allowance  of  time  was  running  125  to  150  minutes 
a  week,  whereas  75  minutes  is  regarded  as  ample;  they  were 
doing  a  grade  of  spelling  and  on  a  type  of  words  for  which  there 
is  no  real  demand;  their  writing  was  excellent.  In  reproducing 
the  median  writing  samples  in  the  Report  we  said  that  the  business 
man  was  respectfully  requested  to  put  a  sample  of  his  own  writing 
by  the  side  of  the  median  sample  for  the  seventh  and  eighth 
grades,  and  see  where  his  own  writing  stood.  In  ai'ithmetic 
they  were  doing  good  work;  in  reasoning  they  were  very  good; 
in  composition  they  were  good.  In  other  words,  the  school, 
in  response  to  persistent  complaint  from  the  business  man,  was 
entirely  overdoing  the  so-called  fundamentals.  They  were  doing 
more  than  there  was  any  reasonable  right  to  expect  the  schools  to 
do,  and  children  were  attaining  an  efficiency  which  business  life 
probably  does  not  demand. 

The  studies  which  have  l)een  made  on  retardation,  which 
began  earlier  than  those  with  the  school  tests,  have  shown  us 
that  every  school  system  is  guilty  of  a  large  waste  in  pro- 
duction, because  many  children  are  hopelessly  mired  down  in 
the  grades  with  almost  no  hope  of  ever  making  progress. 
They  are  discouraged  and  see  little  chance  of  ever  amounting 
to  anything,  because  the  school  is  trjdng  to  put  everybody  thru 
the  same  kind  of  a  process.  Instead  of  adopting  the  business 
man's  method,  and  employing  a  number  of  specialized  pieces 
of  machinery  and  specializing  phases  of  the  manufacturing  pro- 
cess, we  are  using  one  type  of  machinery  and  trying  to  put  every- 
body along  the  same  line,  instead  of  developing  different  types 
of  schools  and  different  types  of  teachers  to  meet  the  different 
types  of  requirements  which  are  presented  by  the  overaged, 
the  non-English  speaking,  those  of  low  mentality,  the  trouble- 
some cases  in  discipline,  and  those  of  various  kinds  of  peculiar 
ability  which  we  meet  with  continually  in  our  schools. 

In  the  matter  of  costs,  also,  we  are  beginning  to  get  some  units 
which  are  of  value.  Why  should  a  classroom  in  one  city  cost 
$8,000  to  erect  against  $4,000  in  another?     Why  should  it  cost 
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four  times  as  much  to  heat  a  chissroom  in  one  building  as  it 
does  in  another?  It  may  be  perfectly  explainable,  but  it  is  some- 
thing that  should  be  looked  into.  If  we  find  Greek,  for  example, 
in  our  high  schools  is  costing  us,  let  us  say,  $300  for  1,000  student 
hours,  and  the  other  subjects  of  the  high  school  are  all  costing 
less  than  $100,  might  it  not  be  a  legitimate  question  as  to  whether 
or  not  we  should  keep  on  teaching  Greek,  unless  we  can  do  it 
in  a  more  economical  way?  And  so  I  might  go  on  enumerating 
large  numbers  of  other  cost  phases  of  the  cost  problem. 

We  might  find,  for  example,  that  the  cost  for  supplies  in  the 
school  system  averages  64  cents;  that  in  one-third  of  the  buildings 
it  was  over  90  cents;  in  another  third  of  the  buildings  it  was 
less  than  20  cents.  A  very  legitimate  question  would  be  whether 
or  not  we  are  providing  too  many  supplies  on  the  one  hand,  and 
whether  or  not  we  are  not  inadequately  supplying  those  building 
which  are  costing  us  less  than  30  cents.  Ought  there  not  to  be 
a  speeding  up  of  those  schools  in  the  matter  of  expenditure; 
especially  would  this  be  the  case  should  we  find  that  that  low 
expenditure  is  correlated  with  a  high  retardation? 

During  the  past  ten  years  a  large  number  of  statistical  studies 
has  been  made;  they  arc  so  numerous  that  one  can  scarcely 
keep  track  of  them.  As  a  result,  we  have  accumulated  a  lot  of 
medians,  graphs,  and  a  lot  of  statistical  data.  Sometimes, 
when  I  read  reports  of  superintendents,  it  seems  to  me  that 
they  have  done  little  more  than  accumulate  graphs  and  medians 
and  statistical  data.  In  themselves  those  things  amount  to 
little  or  nothing;  it  is  the  interpretation  we  give  of  them  that  is 
the  valual^le  thing.  What  we  want  continually  is  to  interpret 
the  results  of  these  studies.  What  do  your  graphs  mean?  Where 
is  your  median  compared  with  what  it  should  be?  What  do  your 
statistical  tables  show  you  as  to  needed  changes?  Do  they  in- 
dicate that  you  are  making  substantial  progress,  or  not?  Do 
they  indicate  that  too  many  things  are  being  done,  or  too  few? 
Do  they  indicate  that  you  need  additions,  or  eliminations? 
Do  they  indicate  that  progress  is  being  made,  or  that  you  are 
slipping  backward?  What  change  in  procedure — in  the  process 
of  manufacture — should  you  make?  What  further  specialization 
in  the  process  of  production  should  be  effected?  What  possible 
economies  can  you  make  in  your  school  system?  That  is,  it 
becomes  practically  the  business  of  the  superintendent  to  become 
the  superintendent  of  a  business.  In  a  sense  his  business  is 
the  business  of  manufacturing  as  good  brain  power  and  as  high 
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a  degree  of  intelligence  as  is  possible  with  the  money  which 
he  has  at  hand.  Of  course,  I  am  keenly  aware  that  there  are 
two  sides  to  school  work.  There  is  one  purely  objective  side, 
which  we  may  test  and  measure;  there  is  another  side  that  is 
subjective,  that  is  personal,  that  is  inspirational,  which  we  can't 
test  in  any  such  way.  Still  I  have  a  very  deep  feeling  that  the 
school  system  which  is  doing  the  objective  things  well  is  probably 
looking  after  the  subjective  things  in  a  good  manner  also,  and  that 
the  school  system  which  is  doing  the  ol)jective  things  unintelligently , 
overdoing  them  or  underdoing  them  and  not  knowing  why,  is 
probably  not  doing  the  subjective  things  so  well  as  they  might 
1)0  done. 

As  I  said,  the  superintendent  of  schools  needs  to  become  the 
superintendent  of  a  business.  In  altogether  too  many  school  sys- 
tems what  we  need  is  a  speeding  up  of  the  whole  educational 
process.  What  we  need  is  the  introduction  of  a  large  number 
of  new  pieces  of  specialized  machinery  in  order  that  we  may 
specialize  the  production  to  meet  a  large  variety  of  markets. 
There  isn't  just  one  market  to  meet.  The  people  of  a  city  spend- 
ing, let  us  say,  $2,000,000  or  $3,000,000  on  their  schools  are  the 
stockholders  of  a  large  enterprise,  and  the  superintendent  of  schools 
is  the  manager  of  the  business.  It  should  be  a  very  large  part  of 
his  business,  and  it  should  be  a  very  large  part  of  the  business 
of  the  stockholders  as  well,  to  see  that  it  is  his  business  to  interpret 
to  the  community  the  progress,  the  successes,  the  failures,  and 
the  lines  of  improvement  of  the  business  undertaking  w^hicli  he 
is  directing. 

Now  what  is  the  significance  of  all  of  this  movement  to  three 
different  classes  of  people:  first,  the  teacher;  second,  the  citizen; 
and  third,  the  superintendent  of  schools? 

To  the  teacher  it  seems  to  me  this  new  movement  means 
a  very  large  amount  in  the  future  in  peace  antl  contentment 
and  personal  satisfaction  with  her  work.  It  means  concise  and 
definite  statements- — eventuall}';  perhaps  not  soon,  or  perhaps 
not  at  once — ^but  it  eventually  means  precise  and  definite  state- 
ments as  to  what  the  teacher  is  expected  to  do  along  the  purely 
objective  lines.  Along  the  purely  subjective  lines,  such  as  in- 
spiring a  love  for  literature,  developing  patriotism,  and  awakening 
high  ideals  and  ambitions,  we  can't  of  course  measure  things 
in  this  way,  but  along  the  definitely  objective  things  of  the 
school  we  can  la}^  down  irreducible  minima,  and  we  can  also  lay 
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down  maxima  beyond  which    the    school    system    will    not    be 
expected  to  go. 

The  investigations  recently  made  in   Boston   are  illustrative. 
They    have    found    in    English,    for  example,    that  these  things 
need  to  be  insisted  upon:   that  a  student  should  be  able  to  copy 
prose  from  dictation,  and  copy  it  accurately;  that  the  student 
should  be  able  to  copy  accurately,  from  a  copy  placed  in  front 
of  him  (or  her),  a  bill  containing  a  dozen  items;  that  the  student 
should  be  able  to  write  a  satisfactory  letter  of  application  for 
a  position;  that  he  should  be  able  to  write  a  simple  composition, 
upon  some  simple  subject  of  his  own  choosing,  and  write  it  with 
proper  punctuation,  paragraphing,  and  capitalization;  that  the 
common  errors  of  the  common  parts  of  speech,  especially  those 
of  the  verb  "to  be"  and  a  few  other  common  verbs,  should  be 
ei-adicated;  that  the  student  should  know  the  common  parts  of 
speech,  and  be  able  to  recognize  them  in  sentences;  that  the  stu- 
dent should  be  able  to  stand  and  read  intelligently  simple  prose, 
so  as  to  carry  meaning  and  conviction  to  those  who  are  listening; 
that  the  student  should  have  learned  and  be  able  to  quote  at 
least  fifty  lines  of  good  classical  prose  or  poetry;  and  that  the 
student  should  be  able  to  stand  upon  his  feet  before  the  class 
and  make  an   oral  presentation   of  some   subject   which    he   has 
looked  up  and  is  interested  in.     IF  the  stud(>nts  finishing  the  eighth 
grade  can  do  those  things,  they  say — that  is,  if  all  of  the  preceding 
teaching  of  English  has  by  the  end  of  the  eighth   grade  reached 
that  standard  of  usefulness  by  means  of  which  a  child  can  do  those 
things — that  these  should  answer  for  the  needs  of  life  and  for  the 
needs  of  the  business  world.     Whether  or  not  that  is  a  final  stan- 
dard, even  for  Boston,  we  may  seriously  question.     Whether  it  is 
the   one    we    should     accept   generally    may    also     be    seriously 
questioned.     It    is,    however,    an   earnest   attempt  on    the    part 
of    a    single    school    system    to    work    out,  for  its  own  needs, 
some  definitions  of  units  of  accomplishment  and  maxima  that 
may  be  insisted  upon  in  the  teaching  of  a  single  sul^ject. 

They  are  also  trying  in  Boston  to  find  out  what  useless 
knowledge  is  being  taught.  They  are  finding,  for  example,  that 
quite  a  large  amount  of  the  geography  taught  is  of  no  real  value. 
It  does  not  interpret  anything  to  the  child;  it  is  soon  forgotten; 
and  it  is  of  no  particular  value.  Again,  what  is  the  use  of  teaching 
a  large  number  of  arithmetical  processes  which  we  shall  never  use? 
I  should  like  to  ask  you,  outside  of  your  business  as  teachers, 
how  many  of  you,  in  the  last  ten  years,  have  had  use  for  any 
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arithmetioal  processes  other  than  addition,  sul^traction,  niiilti- 
pHcation,  division,  simple  and  decimal  fractions,  and  a  little 
interest  and  percentage?    You  have  had  very  little. 

As  we  begin  to  develop  units  of  accomplishment  we  also 
helj)  the  teacher  in  that  we  can  give  to  the  children  some  standards 
by  which  they  may  test  their  own  work.  Just  as  children  in 
city  systems  where  writing  scales  are  hung  up  in  the  classrooms 
are  continually  going  up  and  testing  their  own  writing,  so  they 
may  be  able  to  do  in  time  with  other  subjects  in  the  curriculum 
which  are  capable  of  objective  measurement.  If  a  child  in  a 
city  school  system  says  that  he  has  achieved  standard  11-A  on  a 
Thorndike  writing  scale,  and,  if  we  know  what  a  Thorndike 
writing  scale  is  we  know  exactly  how  well  the  child  can  write. 
If,  however,  he  tells  us  that  he  received  93  per  cent  in  his  report 
last  term,  what  idea  have  we  as  to  how  well  he  can  write?  The 
statement  would  mean  nothing  because  it  is  not  expressed  in 
any  generally  recognized  standard.  So,  for  the  teacher,  the  move- 
ment promises  to  offer  standards  which  she  may  use  with  her 
puj^ils,  and  say  that  whenever  a  pupil  comes  up  to  standard  12, 
or  some  other  unit  of  accomplishment,  the  pupil  may  then  decrease 
the  time  spent  on  the  subject  and  go  on  to  other  work. 

It  will  mean,  too,  an  ultimate  differentiation  of  training  for 
the  different  pupils  which  teachers  now  have,  and  the  specialization 
of  production  with  our  children,  which  will  be  w^orth  very  much 
in  education. 

Again,  standards  for  school  work  will  be  worth  much  to  the 
teacher  in  the  line  of  vocational  guidance.  Superintendent  Bliss, 
of  Montclair,  N.J.,  reproduced,  in  the  last  "Yearbook  of  the 
National  Society  for  the  Study  of  Education",  diagrams  along  this 
line,  for  a  child  who  was  found  to  be  somewhat  feeble-minded, 
for  his  work  in  writing  and  in  arithmetic.  There  was  no  possi- 
bility of  training  that  boy  ever  to  reach  any  good  standard  in 
arithmetic,  and  it  was  foolish  to  try  to  do  so.  He  should  be 
trained  in  the  things  he  could  do;  trained  to  make  himself  as 
self-respecting  as  possible,  and  able  to  care  for  himself.  If  he 
never  reaches  higher  than  the  mental  standard  for  a  twelve- 
year-old  child,  he  still  will  have  some  ideals  of  self-respect, 
some  desire  to  do  whatever  he  does  do  well,  and  the  ability  to  go 
out  into  life  and  earn  his  own  living,  take  care  of  himself,  and 
not  be  a  burden  upon  society. 

From  the  standpoint  of  the  citiz(Mi,  t  h(>  wiiok;  school  standard 
movement    means   the   erecting   of   standards   by    which    he   can 
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estimate  the  efficiency  of  a  school  system.  In  a  book  which 
I  published  recently,  "Public  School  Administration",  I  drew 
an  analogy,  in  one  of  the  chapters,  between  a  board  of  education 
and  what  it  tries  to  do,  and  a  board  for  hospital  control  and  what 
it  tries  to  do.  I  took  a  school  board  of  12  men  and  divided  them 
up  into  committees  which  were  perfectly  descriptive  of  present 
city  school  conditions.  Then  I  conceived  that  this  same  board 
of  12  men  had  been  elected,  not  to  manage  a  school  system,  but 
to  manage  a  municipal  hospital,  and  then  divided  them  up 
analogous  to  hospital  committees.  The  committee  on  kinder- 
garten was  replaced  by  one  on  the  maternity  ward;  the  one 
on  supplies  by  one  on  drugs  and  instruments;  and  so  on  down 
thru  the  list.  I  now  conceived  that  these  committees  proceeded 
to  manage  the  hospital,  and  to  assume  over  the  superintendent 
of  the  hospital  and  the  nurses  the  same  degree  of  authority  which 
similar  committees  now  exercise  over  the  superintendent  of 
schools  and  the  principals  and  teachers.  I  leave  you  to  imagine 
the  result. 

Once  we  work  out  objective  standards  for  accomplishment 
in  school  work  the  citizen  can  be  made  to  understand  when 
there  is  mismanagement  in  a  school  system,  as  he  now  can  under- 
stand it  in  other  lines  of  public  control.  He  has  had  up  to  now, 
however,  no  standards  by  which  he  could  tell  whether  a  board 
of  education  is  outrageously  mismanaging  a  school  system,  or 
whether  a  superintendent  is  of  any  value  whatever  or  not  fit 
for  his  job.  If  the  superintendent  of  schools  goes  to  church 
regularly,  is  a  "nice  fellow",  speaks  well  of  everyone, 
is  very  cautious  and  keeps  out  of  trouble,  and  when  he  meets 
a  mother  with  a  child  says,  "Now,  that  is  a  baby", — he  has  too 
often  in  the  past  been  able  to  get  along  very  well  and  hold  his 
place  for  years  and  years,  and  yet  do  very  poor  work  in  the 
school  system.  We  have  had  almost  no  standards  for  measuring 
up  his  work  or  evaluating  his  services.  Once  erect  a  series  of  objec- 
tive standards  by  which  you  can  tell,  not  only  when  the  children 
in  the  schools  are  making  progress,  but  from  a  cost  accounting 
system  when  expenditures  are  well  apportioned,  and  the  citizen  has 
something  which  will  l)e  useful  to  him  and  will  enable  him  to 
find  out  whether  or  not  the  school  system  is  giving  value  received 
for  the  taxes  which  are  paid  for  its  support. 

From  the  standpoint  of  the  superintendent,  in  the  third 
place,  the  evolution  of  educational  measurements  means  the 
changing  of  education  from    guess-work    to    scientific  accuracy. 
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Wc  "guess"  thai  we  are  not  making  the  progress  in  arithmetic 
we  should,  and  in  consequence  order  teachers  to  add  50  minutes 
a  week  to  the  arithmetic  time.  We  "guess"  that  we  are  not  making 
proper  progi'ess  in  spelling,  so  we  add  a  large  number  of  supple- 
mental words.  We  "guess"  that  our  writing  isn't  as  good  as  it 
ought  to  be,  so  we  increase  the  time  from  20  to  25  minutes  a 
day.  And  so  we  "guess"  all  along  the  line.  Given  definite 
standards  for  work,  a  superintendent  can  then  say  to  his  board 
and  to  the  people:  "Our  schools  have  already  reached  and  passed 
the  standards  which  are  generally  recognized  by  the  men  of  my 
profession  as  being  the  standards  which  children  of  such  age  or 
grade  should  attain.  Our  children  are  able  to  do  such  work,  and 
do  not  need  more  drill."  He  then  has  something  tangible  by 
means  of  which  to  defend  himself. 

It  means  in  turn  much  larger  demands  upon  the  superin- 
tendent. It  means  much  better  professional  training,  and  I  am 
thoroly  convinced  that  in  a  decade  from  now  our  universities 
and  our  colleges  of  education  will  be  giving  a  training  for  school 
administration  of  which  we  scarcely  dream  today.  We  are 
accumulating  information  so  rapidly  that  one  who  is  a  master  in 
his  craft  will  need  to  be  a  constant  student,  just  as  a  good  doctor 
or  a  lawyer  is;  he  will  have  to  discard  politics;  he  will  have  to 
discard  favoritism  and  "pulls"  of  various  kinds;  and  he  will 
have  to  come  to  a  scientific  study  of  his  work,  and  be  able  to 
stand  up  and  defend  his  work  on  the  basis  of  the  standards  and 
units  of  accomplishment  which  the  men  of  his  craft  have  set 
up  as  being  those  which  should  be  used. 

It  means  the  changing,  then,  of  school  administration  from 
a  little  local  job,  to  which  we  can  still  elect  an  old  and  deserving 
lawyei',  as  was  done  in  one  of  our  cities  not  long  ago,  or  to  which 
we  can  promote  a  member  of  the  school  board,  as  was  done 
in  another  city  not  long  ago,  and  the  transferring  of  school 
administration  into  a  national  profession,  in  which  the  super- 
intendent wdll  be  a  citizen  of  the  nation  engaged  in  the  work 
of  managing  schools,  just  as  we  today  have  national  characters 
engaged  in  managing  automobile  factories,  or  steel  plants,  or 
railroads,  or  any  other  form  of  large  public  business.  Then 
he  will  be  selected  because  of  his  expert  knowledge;  he  will  be  held 
to  strict  accountability  for  results  in  terms  of  standards;  and 
he  will  be  expected  to  secure  expert  results.  In  other  words, 
he  will  be  transformed  from  a  politician  into  a  social  engineer. 
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It  means,  I  think,  the  end  of  the  day  when  a  book  man  or 
a  contractor  who  doesn't  Hke  a  superintendent  can  come  into 
town  and  "get  his  scalp",  because  the  superintendent  will  be 
able  to  defend  himself  in  terms  of  the  standards  which  are  recog- 
nized in  his  profession.  It  will  also  mean  that  school  superin- 
tendents will  be  subjected  much  less  to  the  whims  and  local 
foolishness  to  which  superintendents  in  this  country  are  now 
too  often  subjected. 


Round  Table:    Standard  Tests  in  the  Work  of 
School   Administration 


Led  by  Ellwood  P.  Cubberley 


As  I  said  last  evening,  what  we  are  trying  to  evolve  is  a 
series  of  ol)jcctive  measurements  for  the  perfectly  measurable 
things  in  our  school  systems.  As  I  also  said  last  evening,  it  seems 
to  me  that  in  the  near  future  not  only  superintendents  of  schools, 
but  principals  of  schools  as  well,  will  be  expected  to  use  scientific 
measurements — instruments  of  precision — as  means  of  finding- 
out  how  effective  their  work  of  supervision  is. 

As  I  have  gone  about  from  place  to  place  on  school  surveys 
I  have  always  been  struck  with  the  general  weakness  of  the 
elementary  school  principal.  I  remember  in  one  city  which  I 
surveyed  some  35  teachers  had  just  been  dismissed  from  the  school 
system.  After  much  newspaper  criticism  the  lioard  appointed 
a  committee  to  go  around  and  investigate  the  reasons  for  the 
dismissals.  The  committee  heard  evidence  in  each  of  the  school 
buildings,  the  evidence  being  taken  down  by  a  stenographer. 
I  examined  this  evidence  carefully,  and  it  seemed  to  me  that 
altogether  too  many  cases  indicated  that  it  was  the  principal 
who  needed  to  l)e  dropped,  rather  than  the  teacher.  The  charges 
which  he  had  made  against  the  teacher  were  charges  which  showed 
that  he  himself  was  not  up  to  the  job  of  school  supervision  in  the 
way  that  he  should  have  been;  tliat  he  wasn't  handling  his  pro])lem 
properly;  and  that  he  really  didn't  know  what  was  going  on 
or  not  going  on  in  his  schoolrooms.  He  was  handing  out  chalk, 
keejiing  the  keys,  looking  after  the  textbooks,  making  u]) 
statistics  and  time  schedules  and  things  of  that  type,  and  doing 
the  easy  work,  but  so  far  as  helpful  supervision  to  the  teachers 
of  his  ])uilding  was  concei'ncMl  he  wasn't  giving  such  at  all. 

As  I  said  last  evening,  we  have  now  evolved  tests  which  are 
perfectly  definite  for  a  good  many  of  our  school  subjects.  For 
example,  in  writing  it  is  now  very  easy  to  see  at  what  point  in  a 
scale  a  pupil  or  class  is  writing.  Some  of  our  school  systems 
have  made  up  writing  scales  of  their  own,  following  Ayers  or 
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Thorndike  standards,  but  made  up  from  the  work  of  pui)ils  in 
their  own  schools.  These  may  be  just  as  useful  as  the  standard 
scales,  and  may  stimulate  more  interest.  Some  of  our  schools, 
too,  are  in  the  process  of  evolving  composition  scales  which  are 
improvements  over  either  the  Hillegas  or  Harvard-Newton  scale. 
We  might  go  on  and  enumerate  other  subjects  in  which  school 
systems  are  evolving  their  own  scale  standards  for  the  judging 
of  the  quality  of  work  done  by  the  teacher  in  thfe  classroom. 
These  show  the  teacher  where  she  needs  to  jiut  further  emphasis, 
where  things  need  to  be  done  or  where  they  don't  need  to  be 
done,  and  they  reveal  to  the  teachers  that  their  teaching  is 
effective  or  that  it  isn't  effective,  or  that  it  is  somewhere  in 
between. 

Now,  as  I  understood  it,  this  morning  was  to  be  a  round- 
table  discussion,  and  I  wasn't  to  do  much  of  the  talking. 
It  seems  to  me  that  perhaps  I  could  do  best,  after  having  made 
this  preliminary  statement,  if  I  called  on  some  of  you  to 
tell,  very  In-iefly,  how  you  are  using  the  standard  tests  for  the 
purpose  of  checking  up  your  supervision.  In  other  words,  how 
are  you  using  them  as  a  means  of  supervision  if  you  are  a  super- 
intendent, as  a  principal  if  you  are  a  principal  in  a  school?  How 
are  you  using  them  in  order  to  check  up  the  teaching  in  your 
schoolrooms,  and  what  are  the  results  which  you  are  obtaining? 
I  don't  mean  statistical  results.  I  mean  l)rief  general  results — 
what  you  are  getting,  what  they  are  showing  you,  antl  what 
your  teachers  are  getting  out  of  it  all. 

May  I  not  first  ask  for  some  volunteers  who  will  tell, 
in  two  or  three  minutes,  what  they  are  finding  out,  and  how  they 
are  using  the  tests?  The  floor  is  open  to  anyone.  I  am  at  some- 
what of  a  disadvantage  in  not  knowing  you,  otherwise  I 
would  call  your  names.  I  see  my  old  friend,  Mr.  Weir,  in  the 
audience.  He  is,  I  believe,  a  supervising  principal  in  Indianapolis. 
May  I  not  ask  him  to  tell  us,  briefly,  what  use  he  has  made  of  these 
tests  in  school  supervision? 

Mr.  Weir:  I  will  say  it  is  a  little  unfortunate  for  me  to  be 
present.  Dr.  Cubberley,  having  known  me  as  a  boy,  thinks  I 
should  know  something  about  supervision  of  schools  as  a  man. 
Well,  in  Indianapolis  we  have  a  special  system  of  supervision 
of  schools,  a  supervising  system,  perhaps,  that  is  different  from 
many  systems  thruout  the  country,  there  being  eighteen  super- 
vising principals  for  the  various  schools.  We"  are  of  course 
keeping    in    touch    with    the    various    measurements    which    are 
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IxniiS    made — various    systems    of   measurements — and    working 
somewhat  in  connection  witli  them. 

However,  we  have  not  tried  out  many  of  these  systems  of 
measurements.  At  the  present  time  we  are  giving  the  Courtis 
tests — the  first  systematic  work  we  have  done  as  supervising 
l)rincipals.  Many  of  us  have  attempted  some  systems  of  measure- 
ments for  oui'selves.  In  my  own  schools  I  have  used  the  Thorn- 
dike  test  in  writing,  and  have  found  it  effective  in  just  the  way 
in  which  you  mentioned,  the  chikh'en  making  their  own  com- 
parisons. It  has  1:)een  very  interesting  to  watch  them  making  the 
comparisons  of  their  own  penmanship  with  the  ThorncHke  scale. 
Other  than  that  I  have  not  done  work  in  my  school  along  those 
lines. 

Mr.  Myers  (of  Bloomington) :  I  might  say  that  this  is  my 
first  year  in  connection  with  the  Bloomington  schools,  and  cjuite 
a  little  of  the  work  that  has  been  done  before  by  my  predecessor 
has  been  followed  out  by  the  teachers  who  are  now  in  the  corps. 
The  Ayers  scale  has  been  used  a  great  deal  in  assisting  pupils  to 
get  some  standard  of  their  own  work  in  writing,  and  a  great 
many  of  the  tests  that  have  been  carried  on  by  the  School  of 
Education  of  the  University  have  been  carried  on  in  the  Bloom- 
ington schools.  The  results  of  these  have  been  seen;  weak  points 
have  been  found  out;  and  the  teachers  have  endeavored  to 
im])rove  where  the  tests  showed  weaknesses. 

Now,  to  get  the  specific  part  of  that,  I  think.  Professor 
C'ubberley,  if  Miss  Kerr,  the  principal  of  the  Departmental 
Building,  is  present,  she  could  give  a  number  of  these  things  more 
in  detail  than  I  could,  and  I  should  be  pleased  to  yield  the  floor 
to  her,  altho  she  hasn't  known  I  am  intending  to  do  this. 

Mr.  Cubberley:  Will  Miss  Kerr  be  kind  enou'^h  to  tell  us 
of  her  experience? 

Miss  Kerr:  Our  work  in  the  Departmental  School  in  Bloom- 
ington, consisting  of  sixth,  seventh,  and  eighth  grades,  has  been 
chiefly  for  the  last  few  years  on  the  Courtis  tests.  We  have 
used  the  Courtis  tests  as  a  means  of  finding  out  where  we  were, 
in  the  first  place,  and  then,  after  having  studied  our  results  as 
carefully  as  we  were  able,  to  determine  upon  some  procedure 
to  remedy  the  defects  as  we  found  them.  Last  year,  for  instance, 
we  gave  the  Courtis  tests  along  in  February.  We  found  that  our 
particular  weakness  was  in  addition.  We  decided  upon  a  syste- 
matic drill  in  addition  to  remedy  the  defect,  if  possible.  We 
worked  on  that  for  6  weeks,  giving  5  minutes  a  day. 
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Exactly  the  same  method  was  used  in  all  classes  with  all 
children.  We  gave  the  Courtis  test  again  at  the  end  of  the  sixth 
week  to  determine  whether  or  not  we  had  got  the  thing  we  had 
worked  for.  We  found,  when  we  measured  our  school  with  it, 
that  we  had  made  great  progress.  When  we  measured  our  school, 
or  compared  our  school,  with  the  twenty  Indiana  cities  upon 
which  Dr.  Melvin  E.  Haggerty  based  his  report  in  the  University 
"Bulletin''  last  year,  we  found  that  no  school  system  in  Indiana 
came  anywhere  near  what  we  could  do  in  addition. 

I  gave  a  preliminary  report  on  this  study  last  summer  to 
one  of  Dr.  Haggerty's  classes.  I  was  asked  at  that  time  if  this 
thing  was  permanent;  would  it  hold?  We  didn't  know  then 
whether  it  would  or  not,  but  we  gave  the  Courtis  test  again  as 
soon  as  school  opened  in  the  fall  to  see  whether  this  held.  We 
found  that  we  had  294  children  then  in  the  department  who  had 
taken  the  two  previous  tests  and  who  had  had  the  6  weeks'  drill. 
We  found  that,  taking  the  median  for  the  294  children,  irrespective 
of  grades,  and  throwing  them  in  one  large  distribution,  the 
children  had  maintained  a  gain  of  one  whole  example  in  addition, 
showing,  I  think  very  conclusively,  that  the  drill  for  at  least 
66f    per    cent  of  the  children  had  had  a  permanent  effect. 

You  might  wonder  whether  they  had  also  made  any  gain 
in  subtraction,  multiplication,  and  division.  They  had  made 
none.  They  were  practically  where  they  were,  and  in  some  cases 
had  dropped  back.  But  we  feel  that,  for  at  least  two-thirds  of 
the  children,  we  have  given  them  something  permanent. 

That  is  the  use  we  have  made  of  the  Courtis  tests — attempting 
to  find  out  where  our  defects  are,  and  using  some  remedial  agency. 

Mr.  Cubberley:  May  I  ask  you  to  tell  what  effect  the  use 
of  these  had  on  your  teachers?  How  did  they  take  them,  and 
what  were  the  results  from  a  supervisor's  point  of  view? 

Miss  Kerr:  That  is  the  best  thing,  I  think,  that  came  out 
of  it;  the  fact  that  these  teachers  have  been  shown  conclusively  thru 
their  own  work — they  did  the  scoring,  by  the  way,  they  did  the 
major  part  of  the  work.  This  is  the  thing  that  has  been  emphasized 
for  them,  the  biggest  thing — the  individual  differences  in  these 
children.  I  think  they  worked  with  their  children  more  intelli- 
gently because  they  do  know  that  sitting  before  them  here  may  be 
a  group  of  30  eighth-grade  children,  no  two  of  whom  are  alike, 
and,  because  they  have  learned  this  thing  thru  this  objective  work 
which  they  did  with  the  children,  they  can  be  more  patient  with, 
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and  work  more  intoUigeiitly  with,  the  c'apal)ility  thai  eacli  child 
brings  to  the  class. 

Mr.  Cubberley:    You  have  bi-oiight  out  a  vory  good  point. 

Mr.  Myers:  In  the  work  that  Professor  Haggerty  presented 
last  evening  I  was  very  much  interested  in  the  school  number 
of  Bloomington;  there  were  2  or  3  places  that  it  was  above  the 
median  line,  very  distinctly;  there  were  1  or  2  places  that  were 
below  the  median  line.  Now  we  will  be  very  much  interested 
in  seeing  what  can  be  done  to  remedy  that  defect  as  shown  by  that 
study.  I  just  wanted  to  mention  that.  That  is  the  way  we  try 
to  use  the  tests. 

Mr.  Cubberley:  That  is  a  good  point  to  bring  out.  We 
discover  as  a  result  of  our  work  that  certain  things  run  above, 
certain  things  are  much  below  median.  Then  you  have  reason 
for  bringing  up  some,  and  perhaps  for  stopping  your  emphasis 
on  other  points;  that  is,  you  have  brought  the  work  up  enough 
there,  so  stop  and  put  your  emphasis  on  some  other  side. 

Mr.  Horton,  of  Mishawaka,  I  understand,  has  done  some 
work  of  which  we  should  like  to  have  him  tell  us. 

Mr.  Horton:  I  have  done  my  work  not  as  superintendent 
of  schools  at  Mishawaka,  but  as  principal  of  the  high  school. 
I  want  to  speak  first  as  chairman  of  the  Research  Committee 
of  the  Northern  Indiana  State  Teachers'  Association.  Now  we 
have  been  determining  the  policy  of  research  which  we  think 
will  best  meet  the  needs  of  the  high  schools  of  the  State,  and 
Professor  Childs  has  been  kind  enough  to  work  out  the  different 
studies  we  thought  would  benefit  the  high  schools.  This  year  we 
determined  to  study  unit  costs,  and  to  take  up  some  one  phase 
of  that.  There  had  also  been  some  preliminary  work  done  on 
supervised  study. 

The  results  of  the  unit-cost  test,  the  preliminary  results  at 
least,  you  have  seen,  and  we  expect  to  continue  that  study. 
The  algebra  tests  we  expect  to  continue,  and  to  try  to  perfect 
a  test  that  all  of  the  high  schools  can  use,  and  to  arrive  at  some 
standards  in  that. 

Now  as  to  the  supervised  study,  only  about  3  or  4  schools  could 
experiment  on  that.  We  have  been  experimenting  on  it,  and  we 
started  in  with  a  60-minute  period.  The  recitation  was  to  take 
place  in  the  first  30  minutes;  in  the  last  30  minutes  the  time  was 
given  to  supervised  study.  The  recitation  was  to  end  somewhere 
within  the  first  30  minutes.  Then  we  have  been  keeping  figures 
on  the  efficiency  of  study   for  say   5-minute   units,   and  on  the 
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fatigue  curve  of  students  for  the  study,  and  on  their  efficiency 
for  study  at  different  times  of  the  day,  and  so  forth.  Then  we 
have  been  keeping  comparative  results  of  our  supervised  study, 
as  contrasted  with  the  study  under  the  old  plan.  We  have  some 
definite  figures  on  that  line.  Those  were  presented  at  the  high 
school  section  of  the  Northern  Indiana  State  Teachers'  Associa- 
tion in  Chicago. 

Now  as  to  tests  in  the  high  school.  I  have  been  experimenting 
with  some  tests  with  the  idea  of  furthering  the  work  of  this 
research  committee.  One  thing  we  have  in  mind,  I  think,  that 
is  very  liable  to  have  tremendous  results  on  the  high  school  work, 
is  to  get  together  the  groups  of  men  in  the  high  schools  in  different 
States  that  have  been  doing  this  kind  of  work.  That  is,  there  is 
a  group  of  men  in  Illinois  that  have  been  doing  work  on  tests, 
and  there  is  a  group  of  men  in  Iowa,  and  there  is  a  group  of  men 
in  Wisconsin,  and  there  is  a  group  of  men  in  Indiana,  and  we  have 
been  trying  to  get  the  work  of  these  different  groups  of  men 
together,  so  that  when  we  work  out  a  standard  test,  or  a  certain 
line  of  investigation,  that  that  can  be  used  thruout  the  North 
Central  schools,  so  that  we  will  see  where  we  stand  and  where 
all  of  the  schools  stand  in  relation  to  that. 

Mr.  Cubberley:  Will  you  not  tell  us  briefly  how  you  have 
used  this  in  supervision,  which  is  our  main  point  this  morning; 
how  you  have  used  this  in  the  supervision  of  your  teachers? 

Mr.  Horton  :  In  the  supervision  of  my  teachers  I  have  the 
normal  curve  of  the  distribution  of  ability  for  our  grades.  I 
have  had  that  for  the  last  three  years.  I  think  that  has  accom- 
plished wonderful  results.  We  apply  that  to  our  grading  system; 
we  have  it  also;  and  we  use  the  normal  curve  of  the  distribution 
of  ability.  Then  I  have  the  teachers  make  reports  of  how  their 
class  stands  under  that  normal  curve  of  distribution  as  it  has 
been  threshed  out  on  the  screen  two  or  three  times.  That  has 
been  a  wonderful  thing  in  standardizing  our  grading.  That  is, 
it  makes  an  A  mean  a  certain  thing,  a  certain  standing  in  the  class, 
so  that  the  grades  of  the  students  mean  a  very  definite  thing. 
A  teacher  can't  skew  that  to,  at  least,  any  large  amount. 

Then  we  have  used  the  reading  tests.  We  used  the  Thorndike 
reading  tests  on  a  group  of  students  that  we  thought  were  rather 
behind  their  grade,  and  it  showed  definitely  that  they  were  behind 
the  standard  of  the  Thorndike  reading  test.  We  are  going  to 
use  the  Kelly  reading  tests,  too,  and  try  those  out  on  the  same 
section. 
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Our  Latin  department  is  going  to  use  the  vocabulary  tests. 
We  are  just  investigating  a  copy  of  the  Latin  and  German  vocab- 
ulary tests  at  the  present  time,  but  we  are  going  to  secure  those 
for  use  in  our  classes,  and  try  them  out. 

We  are  starting  on  a  line  of  investigation  in  relation  to  our 
high  school  penmanship.  The  study  here  yesterday  showed  that 
the  quality  of  high  school  penmanship  falls  down;  the  speed 
increases,  but  the  quality  falls  down.  Now  we  are  going  to  use 
the  Ayers  scale  for  adult  penmanship,  and  we  are  going  to  try 
to  establish  a  standard  for  our  written  work,  and  I  am  going  to 
give  each  teacher  a  copy  of  that  Ayers  scale  so  that  we  can  keep 
our  writing  up  to  a  certain  standard.  We  are  also  experimenting 
with  supervised  study  with  the  algebra  tests.  Of  course  we 
were  in  on  the  unit  costs,  and  we  will  use  those,  of  course,  for 
the  administration  and  supervision  of  schools  the  same  as  the 
other  schools  have  used  them. 

Mr.  Cubberley:    Mr.  Neighbors,  of  Wabash. 

Mr.  Neighbors:  I  am  not  a  person  who  has  done  a  great 
deal  of  work  with  the  tests,  altho  I  have  done  some  experimental 
work  in  other  lines. 

Mr.  Cubberley:  Tell  how  you  have  used  them  with  the 
teachers. 

Mr.  Neighbors:  I  haven't  used  them  myself,  but  my  pred- 
ecessor, who  left  Wabash  al^out  two  months  ago,  did.  I  couldn't 
tell  how  he  used  them,  but  the  conclusions  have  been  that  these 
tests  emphasized  more  or  less  certain  danger  signals,  or  set  up 
certain  guide  posts.  You  can't  always  draw  certain  definite 
conclusions  after  having  given  tests,  but  you  can  always  tell 
that  here  is  a  condition  which  needs  investigation,  and  I  know 
that  that  at  least  was  his  policy,  and,  from  the  little  experience 
I  have  had,  has  been  mine. 

Mr.  Horton  suggested  one  thing  I  should  like  to  mention, 
altho  it  may  be  just  a  little  off  the  subject.  It  emphasizes  the 
general  idea.  In  the  matter  of  the  curve  of  distribution  of  grades, 
we  had  some  occasion  to  make  some  experiments  several  years 
ago  and  we  found  that  our  curve  was  decidedly  skewed  in  favor 
of  the  eighth  grade,  a  grade  which  happened  to  mark  the  par- 
ticular point  of  exemption  in  our  high  school  in  this  year.  We 
did  away  with  the  whole  exemption  system,  and  at  the  end  of  the 
first  term  I  made  another  curve  of  distribution  for  the  grades 
in  the  high  school,  and  found  that  that  curve  behaved  in  a  jx'r- 
fectly  normal  way,  with  no  skewing  at  all  in  favor  of  the  eighth 
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grade,  which  might  argue  that  the  teachers  had  been  somewhat 
influenced  by  the  fact  that,  when  they  got  near  to  the  decision 
point,  not  knowing  exactly  what  to  do,,  they  gave  the  pupil  the 
benefit  of  the  doubt  and  skewed  the  curve  in  favor  of  the  exemption 
grade.  It  meant  for  us  at  that  time  that,  if  this  curve  was  skewed 
in  the  direction  of  that  particular  grade,  this  was  the  cause  of  it, 
and  it  seems  to  me  that  is  the  whole  point  of  tests  of  this  sort. 
Here  is  something  that  needs  investigating,  and  let's  see  what  the 
cause  is. 

Mr.  Cubberley:  Has  someone  else  some  contribution  to 
make? 

Mr.  Giles  (of  Richmond) :  Mr.  Chairman,  most  of  us  do 
not  have  a  single  officer  in  the  force  who  can  give  the  test  thruout 
the  system,  and  if  we  do  not  have  that  difficulty,  one  of  the 
biggest  difficulties  then  is  to  get  the  test  given  under  uniform 
conditions.  For  instance,  in  giving  the  spelling  test  it  was  given 
by  the  principals  of  our  ]:)uildings,  and  whereas  our  median  was 
along  a])out  70,  where  it  ought  to  be  in  most  buildings,  in  one 
building  the  median  was  up  in  90,  and  that  was  the  building 
that  had  the  lowest  median  in  every  other  test  that  we  gave. 
Now  that  meant  something  was  wrong,  you  see.  There  is  a  very 
great  temptation  to  get  ahead  of  the  game,  somehow. 

The  remedy  that  we  have  at  Richmond  for  that  you  may  not 
all  be  able  to  use.  We  have  all  of  our  pupils  in  a  junior  high 
school,  and  in  giving  the  Courtis  test  a  few  weeks  ago  we  gave 
it  simi)ly  to  the  seventh  and  eighth  grade  pupils.  It  was  given 
by  the  teachers  in  the  junior  high  school,  and  instead  of  simply 
writing  on  their  papers  the  "Garfield  school",  they  wrote  the 
school  that  they  came  from,  and  I  used  it  as  a  check  on  the  super- 
vision of  our  ward  schools  for  the  first  six  grades  in  arithmetic. 
You  see  there  couldn't  be  any  objection  to  that.  It  was  turned 
over  to  the  principals  to  find  out  why  their  score  happened  to  be 
low  or  high.     Now  just  one  other  point. 

We  are  using  the  Jones  vocaljulary  list  in  primary  reading. 
The  principals  are,  together  with  the  kindergarten  teachers, 
giving  that  in  the  primary  grades,  the  1-A,  2-B,  2-A,  and  3-B. 
The  purpose  of  that  is  to  test  out  our  method  of  reading.  We 
have  a  variety  of  methods.  Some  teachers  are  using  pretty 
largely  the  Ward;  some  the  Rockford  and  the  reading  literature; 
some  the  Aldine;  some  the  Beatty.  There  are  ciuite  a  variety 
of  methods  being  used  by  our  primary  teachers,  and  we  are  giving 
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this  Jones  vocabulary  t(\st  in  order  to  get  some  check,  if  possible, 
on  oiH-  methods  of  primary  reading. 

Mr.  C'ubberley:    Mr.  Childs. 

Mr.  Childs  (of  Indiana  University) :  I  wish  to  make  one 
statement.  I  su])]X)se  there  are  in  Indiana,  in  spite  of  the  fact 
that  Indiana  has  excellent  superintendents  in  this  movement, 
a  few  possi])ly  who  test  just  for  the  sake  of  testing,  but  they  soon 
(piit  that  because  there  is  too  much  work  connected  with  it. 

\Mthin  the  last  four  weeks  I  have  had  four  or  five  requests 
from  principals  and  superintendents  out  in  the  State,  writing 
in  Inu'e  for  data  that  we  have  collected  in  some  of  these  studies, 
stating  definitely  that  they  wished  them  for  the  purpose  of 
l)ringing  about  certain  reorganizations  in  their  work  on  which 
they  felt  that  information  would  be  valuable.  I  am  glad  some  of 
the  superintendents  and  principals  are  finding  some  value  in 
some  of  these  things,  and  are  making  use  of  them. 

Mr.  Cubberley:  I  think  the  contributions  which  have 
been  made  so  far  indicate  rather  clearly  how  we  may  use  these 
tests.  Tliere  are  many  ways.  Perhaps  I  might  close  this  dis- 
cussion by  telling  you  some  that  I  have  come  in  contact  with 
myself,  which  will  also  reveal  usefulnesses  somewhat  along  the 
line  of  those  which  have  been  mentioned. 

One  of  the  most  interesting  studies,  I  think,  that  I  have  ever 
been  engaged  in  was  the  surve>  of  the  school  system  of  Butte, 
Mont.  There  may  be  less  promising  places  in  the  United  States 
than  Butte,  but  I  have  never  seen  them.  Something  like  80,000 
people  are  collected  there  on  the  hillsides;  the  whole  town  under- 
mined with  copper  shafts  and  tunnels;  saloons  everywhere; 
everything  run  as  a  wide-open  town.  It  is  a  place  where  almost 
nothing  green  grows,  the  smelters  having  killed  almost  every- 
thing. To  have  lawns  the  dirt  must  be  brouglit  in  from  the 
outside.  There  are  a  few  bushes  and  a  few  trees  seven  or  eight 
feet  high  in  town,  but  that  is  about  all.  The  children  know  almost 
nothing  of  nature,  or  of  proper  home  life,  because  the  schools 
were  doing  almost  nothing  to  teach  them  these  things.  There 
was,  at  the  time  we  tested  the  work,  no  domestic  science  in  the 
grades,  and  only  a  little  poor  manual  training.  Everything  con- 
centrated on  the  formal  book  subjects.  The  conception  of  the 
school  seemed  to  be  to  get  a  room,  a  stove,  and  a"  teacher,  and 
have  the  pupils  get  their  books  and  come  and  learn  what  they 
contained. 
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Now  you  can  readily  imagine  that  a  school  system  such 
as  I  have  described,  when  tested,  would  test  up  rather  high 
along  purely  formal  lines,  and  would  test  low  along  lines  which 
involved  reasoning,  and  that  is  exactly  what  we  found.  All 
of  the  evidence  from  the  tests  pointed  to  a  school  system  emphasiz- 
ing memory  work  as  the  chief  end  of  the  educative  process.  The 
pupils  ranked  high  in  spelUng;  and  high  in  addition,  subtraction, 
multiplication,  division;  but  very  low  in  composition,  and  in  the 
reasoning  tests  of  arithmetic.  The  children  showed  up  poorly 
in  all  reasoning  tests;  nothing  in  the  school  system  emphasized 
that  side.  I  don't  know  of  a  place  where  tests  have  been  made 
where  the  character  of  the  school  system  tested  has  stood  out  so 
clearly  as  did  the  schools  of  Butte;  what  was  needed  there  was 
a  radical  reorganization  of  the  school  system.  If  the  super- 
intendent of  schools  was  hampered  by  his  board  of  education, 
then  the  board  of  education  needed  to  stop  interfering  with  the 
schools.  If  the  superintendent  was  not  hampered  and  could  go 
ahead,  then  what  they  manifestly  needed  was  a  new  super- 
intendent of  schools.  That  that  school  system  needed  reorganiza- 
tion from  top  to  bottom  was  clearly  shown. 

Turning  to  Salt  Lake  City,  I  can  cite  another  very  good 
example,  but  of  a  very  different  type.  The  schools  there  as 
wholes  showed  up  well  m  all  of  the  tests,  but  whenever  we  began 
to  analyze  differences  between  grades  in  different  buildings  we 
found  quite  marked  extremes.  Here  was  one  building  which  was 
uniformly  high  in  almost  everything;  there  another  building  which 
would  run  uniformly  low  in  almost  everything.  The  natural 
question  that  ought  to  be  asked  of  the  principals  is  how  they  could 
explain  such  large  differences.  Wherever  we  tabulated  single 
rooms  or  grades  we  found  the  differences  among  the  children 
within  the  grades  were  even  more  marked  than  the  differences 
between  buildings.  The  report  tried  to  call  the  attention  of  the 
school  authorities  to  this  condition,  and  to  say  that  what  the 
school  system  had  done  for  the  mass  it  ought  to  set  itself  seriously 
to  try  to  do  for  individuals, — what  the  school  system  had  accom- 
plished so  well  up  to  now  for  the  average  child,  it  needed  to  set 
itself  to  do  for  the  individual  child.  For  example,  in  spelling, 
40  per  cent  of  the  children  weren't  tested  by  the  test  at  all. 
That  is,  40  per  cent  of  the  children  made  100 — they  spelled 
everything  they  were  given,  and  therefore  they  were  not  really 
tested.  When  we  found,  in  say  a  sixth-grade  room,  from  25  to 
30  per  cent    of  the  children  making  100,  and  perhaps  15  to  20 
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per  cent  of  the  children  not  coming  up  to  a  fourth-grade  average, 
the  natural  question  to  the  supervisor  is,  why  these  differences? 

Again,  a  retardation  sheet  taken  for  an  entire  school  system, 
or  for  any  building  in  the  school  system,  would  show  similar 
results.  In  the  city  of  Portland,  for  example,  where  I  directed 
a  survey  in  1913,  a  retardation  sheet  there  showed  conditions 
that  were  very  surprising  to  the  school  principals.  Statistics 
published  in  the  annual  school  report  showed  that  there  were 
over  1,500  children  over  15  years  of  age  in  the  elementary  schools. 
When  we  asked  the  building  principals  to  give  us  an  age- 
and-grade  distribution  sheet  for  their  building,  and  we  showed 
them  the  charted  results,  many  were  greatly  surprised  to  find 
that  in  some  of  the  best  schools  and  some  of  the  best  residential 
sections  of  the  city  the  retardation  would  run  20,  25,  and  30 
per  cent.  This  illustrates  how  a  retardation  sheet  may  be  used 
as  a  means  of  supervision. 

The  Butte  study  showed  clearly  the  need  of  a  reorganization 
of  the  school  system.  In  Salt  Lake  City,  where  average  con- 
ditions were  very  good  and  a  good  piece  of  constructive  work 
on  the  part  of  the  superintendent  of  schools  was  revealed,  the 
need  of  a  more  individual  study  of  conditions  was  shown.  The 
study  of  the  Salt  Lake  City  schools  was  certainly  as  fine  a  vindica- 
tion of  a  superintendent's  work  as  anything  which  has  appeared 
in  print  in  the  line  of  survey  work,  and  yet  it  pointed  out  in- 
dividual differences  in  every  school  in  that  city  that  were  rather 
alarming  when  viewed  from  the  standpoint  of  the  interests  of  the 
children.  They  were  dealing  too  much  with  the  needs  of  the  so- 
called  "average  child." 

Have  we  not  been  using  entirely  too  much  "average",  or  mass 
results?  It  is  only  recently,  as  you  and  I  well  know,  that  we  have 
Ix'gun  to  pay  some  attention  to  the  child  of  defective  mentality, 
or  the  child  with  physical  defects.  We  are  beginning  to  segregate 
the  retarded  child,  the  child  who  is  crippled,  the  child  who  is  of 
a  low-grade  mentality,  or  who  is  anemic,  or  tubercular,  and  are 
beginning  to  provide  educational  advantages  for  such  suited  to 
their  rate  of  running.  The  most  useful  child  in  the  school  system, 
tho,  is  the  child  who  is  above  average  ability  and  who  too  often 
today  is  fooling  along  and  dawdling  along  because  he  or  she  is 
never  given  work  which  is  up  to  capacity.  They  represent  what 
we  call  the  "gifted"  children,  and  they,  from  the  standpoint  of 
democracy,  are  the  hoi)e  of  our  country.  And  yet  we  have  as 
yet  done  almost  nothing  for  such  in  our  school  systems,  and  it 
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may  bo  some  timo  l)efore  we  will  be  able  to  ^ivv  them  ihe  addi- 
tional advantages  they  deserve.  Too  often  we  are  unwilling  to 
recognizee  the  existence  of  such  children  in  our  schools. 

A  great  many  people  will  tell  you  that  such  advantages 
can't  ])e  arranged  satisfactorily.  We  have  recent  experiments 
which  prove  'the  contrary.  Here  is  one.  At  Montclair,  N.J., 
a  few  years  ago,  they  organized  a  class  of  sixth-grade  children 
from  among  those  who  were  better  than  the  average  fifth-grade 
child.  This  class  they  put  thru  the  sixth,  seventh,  and  eighth 
grades,  in  two  years,  which  can  easily  be  done  with  selected 
children.  The  instructions  to  the  teacher  were  not  to  push  them, 
])ut  to  give  them  work  which  was  up  to  their  ability.  When  they 
had  finished  the  eighth  grade  this  class  was  tested  in  comparison 
with  children  who  had  taken  the  full  three  years.  They  measured 
higher  than  the  children  who  had  taken  the  longer  time.  They  had 
not  been  injured  by  the  process,  while  democracy  had  gained 
a  clear  year  in  the  training  of  those  youngsters  and  in  getting 
thf^m  into  their  life  work.  More  than  that,  instead  of  staying 
in  the  school  and  dawdling  along  and  learning  habits  of  loafing, 
they  had  been  learning  habits  of  work. 

I  am  thoroly  convinced  that  a  great  many  college  boys  who 
come  to  us  and  loaf  their  way  thru  college  have  learned  to  loaf 
down  in  the  grades,  because  they  have  been  brighter  and  have 
had  better  home  conditions,  have  had  a  better  economic  back- 
ground to  ensure  the  better  home  conditions,  and  are  often  better 
in  mental  capacity,  but  they  have  never  been  worked  up  to  capac- 
ity in  school.  Instead  they  have  learned  to  slide  along;  to  loaf 
on  the  job  and  bluff  thru;  and  they  come  to  college  and  bluff 
and  loaf  thru  and  go  out  into  life  as  bluffers  and  loafers.  They 
may,  due  to  superior  ability,  do  fairly  good  work,  but  they  never 
realize  their  possibilities  at  all. 

Again,  we  might  use  these  tests  in  supervision  in  other  ways. 
Suppose  we  take  the  test  one  year,  and  the  next  year  and  for  a 
number  of  years  in  succession  make  the  same  kind  of  a  test,  in 
the  meantime  calling  attention  to  where  we  are  standing,  actually 
and  comparatively.  Here  is  where  we  stand  in  the  Courtis  tests; 
here  is  where  we  stand  in  reasoning  tests;  here  is  where  we  stand 
on  a  Buckingham  or  an  Ayers  spelling  scale;  here  is  where  we 
stand  on  a  Thorndike,  Ayers,  or  Freeman  writing  scale.  Now, 
where  are  we?  Where  are  we  going?  Was  our  work  better  in 
1916  or  1915  than  in  1914  or  1913?  Are  we  making  steady  and 
consistent   progress,    or    are    we    holding   our    own?      Such   are 
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p(M-f(H!tly  l(>gitimate  fiucstions  of  supervision  whicli  these  tests 
can  answ(n'. 

The  one  that  Miss  Kerr  gave  is  a  very  good  one.  After 
>()u  have  coached  up  your  chihlren  in  arithmetic,  do  they  hohl 
tlie  training,  and  especially  do  they  hold  it  over  summer  vacation? 
Tiiis  is  a  ]ierfectly  legitimate  question  to  ask,  and  if  you  find  that 
they  do  hold  it,  you  have  a  good  deal  of  reason  for  congratulation. 

Tak(>  your  spelling  in  the  same  way,  or  your  geography. 
I  am  convinced  that  a  great  many  of  the  facts  we  teach  in  geog- 
raphy ar(>  of  no  particular  value.  Well,  how  are  we  going  to 
])rov(>  it?  That  is  my  opinion.  You  don't  agree  with  me.  Well 
and  good;  then  so  far  it  is  only  a  matter  of  personal  opinion, 
and  the  only  way  in  which  we  will  be  able  to  settle  the  question 
will  be  to  make  up  some  tests  which  will  test  the  efficiency  of 
this  instruction  from  the  standpoint  of  its  aliility  to  stick  or  its 
usefulness  for  life  work. 

We  can  also  test  the  instruction  from  the  standpoint  of 
usefulness.  Take  domestic  science,  for  example.  We  have  had 
much  discussion  recently  as  to  how  best  to  teach  domestic  science. 
Slunild  we  teach  it  in  the  old  formal  way  of  beginning  to  learn 
how  to  light  a  stove,  and  then  how  to  cook  an  egg,  and  bake 
a  loaf  of  bread,  and  a  cake,  and  so  on;  or  should  we  take  up  the 
(Jary  idea,  where  the  girls  go  in  and  help  run  the  cafeteria  and 
out  of  that  learn  their  domestic  science? 

We  Avill  never  settle  such  questions  by  argument.  The  old- 
fashioned  domestic  science  teacher  says  that  the  Cuiry  system  is 
mer(>  child  labor.  The  Gary  man  says  it  is  good  teaching.  One 
opinion  is  perhaps  worth  just  about  as  much  as  the  other.  Can 
we  not  evolve  some  tests  for  testing  the  things  which  domestic 
science  is  supposed  to  teach,  such  as  the  developmcnit  of  the 
practical  judgment  of  the  girl  and  the  giving  her  an  insight  into 
life's  problems,  so  that  she  can  use  her  head,  in  addition  to  knowing 
how  to  cook  and  bake  and  take  care  of  a  kitchen? 

Now  with  some  such  tests  as  these  we  might  measure  up 
a  nundx'r  of  Gary  systems  with  a  number  of  systems  using 
the  other  plan,  and  see  where  they  stand.  It  is  possible,  by  means 
of  tests  of  this  kind,  to  keep  questioning  all  the  time  the  efficiency 
of  your  instruction  and  the  effectiveness  of  your  supervision. 
Let  me  give  you  an  illustration,  whicli  Bobbitt  gives  in  one  of 
the  re]iorts  of  the  National  Society  for  the  Study  of  Education. 
He  mentions  the  Union  Pacific  railroad,  which  maintains  a  bureau 
of  efficiency.     Some  new  process  is  evolved,  or  sonu^  new  thing  is 
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to  be  done,  and  a  half-dozen  different  ways  of  doing  it  are  soon 
evolved.  At  first  they  are  all  permitted,  but  the  tests  at  the  end 
of  a  year  or  two  show  conclusively  that  two  of  the  ways  are  very 
much  better  than  the  others;  then  the  other  four  are  taken  out, 
and  one  of  the  two  approved  ways  is  prescribed.  If  the  tests 
continue  to  show  that  either  one  of  the  two  gives  about  the  same 
results  the  two  are  allowed  to  be  used,  but  if,  after  discarding  the 
others,  one  of  the  two  comes  clearly  to  the  front  as  the  better, 
then  that  one  becomes  the  standard  method  for  the  Union  Pacific 
railroad.  In  so  far  as  two  methods  will  give  approximately 
equal  results  the  two  are  allowed,  because  they  allow  for 
differences  in  individuals  that  it  is  well  worth  while  to  preserve. 

We  are  today  in  the  matter  of  grade  instruction  vs.  depart- 
mental work  for  the  upper  part  of  the  elementary  school  course 
in  much  the  position  of  the  Union  Pacific  railroad  when  it  allows 
either  of  two  methods  to  be  used,  but  we  may  come  to  the  time 
when  the  present  eight  years  of  graded  work  may  l)e  interdicted 
as  not  giving  the  best  results  for  the  children. 

The  large  point  I  want  to  leave  with  you  is  that  there  is  a  whole 
series  of  problems  which  a  superintendent  can  keep  putting  up 
to  himself,  and  to  his  principals  and  teachers  in  turn  which 
involve  a  test  or  a  measurement  to  find  any  answer  that  is 
really  an  answer. 


Measurements  Applied  to  School  Financing 


Ellwood  p.  Cubberley 


We  are  everywhere  over  the  United  States  facing  the  ques- 
tion of  increased  money  for  schools,  and  almost  everywhere 
superintendents  and  boards  of  education  are  looking  about 
trying  to  find  what  they  can  do  with  the  problem  they  are  facing. 
Public  education  is  essentially  the  process  of  spending  more 
money  in  a  better  way,  and  each  improvement  in  the  matter 
of  education  which  we  make  is  almost  inevitably  something 
which  costs  more  money. 

If  we  want  a  cheap  school  system  the  way  to  do  it,  of  course, 
is  to  make  the  schools  as  poor  as  is  possible.  If  you  get  very 
cheap  teachers;  if  you  have  very  poor  buildings;  if  you  supply 
poor  and  an  inadequate  quantity  of  school  supplies;  if  you  don't 
do  anything  whatever  to  enforce  compulsory  attendance;  if  you 
let  as  many  children  as  possible  go  to  private  schools;  and  if 
you  don't  develop  night  schools,  or  any  vacation  schools,  or 
any  vocational  schools,  you  can  perhaps  cut  the  number  of 
children  who  attend  the  public  schools  to  less  than  50  per  cent 
of  the  total  number,  and  you  can  also  make  it  so  that  the  cost  per 
pupil  each  year  will  be  small. 

There  are  some  school  systems  in  the  United  States  that  would 
almost  seem  to  be  run  on  that  basis.  They  have  their  school 
system  very  cheaply  managed ;  they  employ  home  girls  as  teachers, 
and  at  the  lowest  possible  market  rates;  tl\ey  supply  just  as  little 
equipment  as  is  possible;  and  their  education  is  very  largely 
book  instruction.  The  main  things  they  need  are  a  room,  some 
seats,  a  stove,  and  a  teacher;  the  pupils  learn  what  is  set  down 
in  the  books.  The  course  of  study  frequently  says:  "Begin  at 
page  42  and  go  to  page  82,  and  stop." 

Such  a  school  system  is  not  only  exceedingly  cheap,  but  it 
requires  little  forethought  as  well.  Whenever  such  cities  begin 
to  employ  superintendents  who  come  to  conferences  for  educa- 
tional measurements;  who  get  to  studying  the  amount  of  waste 
products  in   their   schools  and  how  they  may  utilize  this   waste 
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product  and  get  better  results;  who  seek  to  introduce  new  and 
specialized  pieces  of  machinery,  as  it  were,  in  tiie  manufacture 
of  young  people,  so  that  they  can  turn  out  a  larger  percentage 
of  efficient  men  and  women,  and  have  a  smaller  percentage  of 
waste;  and  who  begin  to  ask  for  better  t(>achers  and  better  teaching 
('(luipment,  each  one  of  which  costs  money,  the  costs  for  (Mlucation 
begin  to  increase  rapidly. 

There  was  a  time,  10,  15,  or  in  some  ])la('es  20  years  ago, 
when  it  wasn't  a  difficult  matter  to  get  more  money  for  the  public 
schools.  The  school  authorities  asked  for  it,  and  if  it  seemed  at 
all  feasi])le  got  it  from  the  town  council.  That  day,  I  think, 
has  ijassed  forever,  and  we  shall  have  clearly  to  prove  our  needs 
for  nearly  all  the  money  we  get  from  now  on.  We  shall  have  to 
show  that  we  have  equal  or  greater  needs,  as  I  think  I  said  last 
night,  than  has  the  bureau  of  health,  or  the  bureau  of  milk  su])ply, 
or  the  Inireau  looking  after  infant  mortality,  or  the  sewer  depart- 
ment, or  the  street  departmen',  or  the  park  department,  or  the 
police  department, — all  of  which  are  now  in  the  struggle  foi-  city 
funds,  and  this  presents  a  rather  hard  problem. 

Education  is,  in  a  sense,  a  surplus  luxury.  You  are,  in  a  sense, 
doing  something  for  the  next  generation,  which  is  wholly  different 
from  work  in  which  you  can  demonstrate  that  you  are  going  to 
get  your  money  back  at  an  early  date.  The  tax-paying  generation 
is  never  paid  back  for  educational  work.  About  the  only  way 
in  which  one  can  ever  render  repayment  for  the  service  which 
has  been  rendered  to  him  is  to  render  it,  in  turn,  to  the  next 
generation.  We  are  continually  working  to  make  a  new  citizen- 
ship, and  all  the  money  we  put  into  education  is,  from  a  certain 
point  of  view,  a  waste  of  funds.  We  have  to  look  at  it  from  the 
larger  point  of  view  of  city  interests,  State  interests,  and  national 
interests,  to  become  enthusiastic  about  levying  taxes  on  our- 
selves to  educate  someone  else's  children,  and  especially  to  educate 
them  along  higher  and  highly  differentiated  lines  of  training. 
The  problem  of  increasing  need  for  funds  for  education,  and  an 
increasing  pressure  for  funds  from  all  other  city  departments, 
is  one  which  we  as  school  officers  will  have  to  face  from  now  on. 
If  you  happen  to  be  fortunate  enough  to  be  in  a  State  where 
the  city  council  hasn't  anything  to  do  with  it,  and  where  the 
school  board  can,  by  State  law  or  city  charter,  levy  their  own 
funds,  up  to  a  certain  limit,  you  have  very  decided  advantages. 
I  have  been  contending  for  some  years  that  that  is  the  rational 
scheme;  that  we  ought  to  have  it  arranged  in  that  way;  that  there 
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ought  to  be  guaranteed  in  the  city  charter,  or  better  still,  in  the 
State  law,  a  definite  number  of  mills  that  may  be  levied  by  the 
l)oard  of  education  on  its  own  judgment,  without  ever  asking  the 
permission  of  the  city  council.  If  a  still  larger  school  levy  is  needed 
the  question  should  be  submitted  to  the  people  of  the  city  for 
a  vote,  and  not  to  the  city  council,  and  for  the  very  important 
reason  that  the  schools  seem  to  me  to  be  not  a  part  of  the  city 
government,  in  the  sense  that  the  patronage  departments  are, 
but  rather  to  stand  coordinate  with  the  church  and  the  home  for 
the  improvement  of  the  race  and  for  doing  things  for  the  next 
generation.  Such  an  institution  we  can  hardly  expect  an  ordinary 
town  council  to  be  enthusiastic  about. 

In  a  few  of  our  States  this  has  been  done,  and  in  many  of 
these  States,  within  the  last  few  years,  there  has  been  an  effort 
on  the  part  of  mayors,  town  councilmen,  and  politicians  to  break 
down  such  a  State  law  or  charter  provision.  In  Kansas,  in  particu- 
lar, there  was  quite  a  movement  made  by  the  mayors  last 
year  to  bring  the  schools  under  the  city  government,  to  unify 
the  city  tax-rate,  they  said.  To  unify  it,  to  be  sure,  but  is  there 
any  reason  why  it  should  be  unified? 

New  York  State,  recognizing  health  as  a  valuable  asset,  created 
a  State  health  council  and  gave  it  large  independent  powers. 
It  is  almost  a  legislature  in  itself.  The  State  did  this  simply 
because  it  was  felt  that  the  public  health  was  too  important 
to  be  left  to  the  State  legislature  or  to  the  town  councils,  or 
even  to  town  boards  of  health  to  control.  The  State  deemed 
it  a  matter  of  such  vital  importance,  and  one  which  looked  so 
to  the  future,  that  it  ought  to  be  organized  separately  and  by 
itself,  and  with  large  powers  of  its  own.  Accordingly,  this  State 
health  council  has  power  to  nullify  a  local  health  ordinance  and  to 
institute  a  State-wide  ordinance,  if  it  sees  fit  to  do  so. 

So,  in  a  way,  the  schools  are  of  enough  importance,  are  co- 
ordinate enough  with  the  home  and  the  church  and  look  enough 
to  the  future,  that  we  ought  to  try  to  keep  such  legislation  in 
States  where  we  have  it,  and  in  the  reorganization  of  city  school 
systems  with  new  charters  or  State  school  systems  with  new 
laws,  we  ought  to  try  to  get  provisions  inserted  in  these  which 
will  give  to  school  boards  the  power  to  levy  certain  amounts  of 
money  for  maintenance,  and  certain  amounts  for  buildings  and 
repairs,  and  without  any  regard  to  approval  by  the  city  council. 
For  further  amounts  the  matter  should  be  submitted  to  a  vote  of 
the  people,  rather  than  to  a  vote  of  the  city  council. 
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In  many  places,  the,  this  cannot  be  done,  and  we  shall  have 
to  continue  to  go  to  the  council  and  prove  oin-  needs.  Probably 
we  shall  have  to  ask  for  what  we  want,  and  take  what  we  can 
get.  In  many  of  our  cities  we  are  today,  as  a  result  of  such  a 
process,  having  a  serious  struggle  to  maintain  the  schools  in  the 
way  in  which  they  ought  to  be  maintained. 
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I  have  a  couple  of  drawings  here.  They  ilkistrate  well  the 
problem  which  faces  two  cities  where  the  city  council  has  complete 
control  of  the  school  tax-rate.  This  one  shows  conditions  in  the 
city  of  San  Francisco.  The  upper  line  represents  the  total  tax- 
rate  as  it  has  increased  from  1908  to  1914;  the  lower  one  represents 
what  the  schools  got  out  of  it,  and  you  can  easily  see  from  the 
drawing  that  the  schools  have  been  losing  continually.  Then 
I  have  the  percentages  across  the  line  showing  what  pcsrcentage 
of  the  total  city  tax-rate  has  gone  for  schools,  and  these  show 
that  it  has  decreased  from  18.9  per  cent,  to  9.5  pei'  cent. 

The  next  one  is  the  city  of  Schenectady,  N.Y.,  which  illustrates 
the  same  process.  The  upper  one  is  the  total  city  tax-rate,  and 
you  see  it  has  been  aeroplaning,  but  when  j'ou  look  at  the  school 
tax-rate  it  hasn't  gone  up  so  fast.  It  has  decreased  from  27.5 
to  24.1  per  cent.  It  has  actually  lost  in  percentage  of  the  total, 
tho  it  has  done  better  than  San  Francisco — increased  somewhat 
actually.  San  Francisco's  amount  for  schools  has  actually  gone 
downward. 

These  two  cities  illustrate  conditions  in  dozens  of  other  cities 
where  the  city  control  of  the  school  tax-rate  prevails.  The  school 
l)oard  goes  before  the  town  council  and  asks  for  what  it  needs. 
The  town  council,  tho,  often  isn't  intci-ested  in  tilings  which 
look  so  far  to  the  future.  It  is  interested  primai'ily  in  the  i)atronage 
departments,  and  the  great  patronage  departments  are  parks, 
streets,  police,  fire,  and  sewer.  These  are  very  desirable  things 
to  have,  no  doubt,  but  as  Mayor  Low  once  said,  in  New  York, 
what  is  the  use  of  having  parks  and  streets  if  we  don't  have 
schools?    Schools  must  come  first. 

In  the  process  of  trying  to  prove  your  needs  I  think  we  school 
men  must  come  to  a  new  kind  of  bookkeeping.  Last  summer 
I  was  employed  by  the  city  of  Oakland.  Cal.,  to  do  a  little  piece 
of  woi'k,  which  was  a  very  interesting  one  to  me.  The  city  of 
Oakland  has  been,  for  some  time,  developing  its  municipal  under- 
takings at  a  veiy  rapid  rate.  They  built  a  city  hall,  first  planned 
to  cost  $1,000,000,  but  they  found  this  entirely  inadequate,  and 
finally  spent  $2,000,000  on  it.  They  started  to  build  a  municipal 
auditorium  at  a  cost  of  $500,000,  but  when  they  got  it  finished 
they  found  that  it  had  cost  them  $1,000,000.  They  have  started 
on  a  wonderful  plan  for  the  development  of  city  docks.  They 
have  fine  streets,  and  a  great  many  parks  and  drives,  all  of  which 
are  very  nice.  They  have  been  building  very  expensive  school- 
houses,    many    of    them    low,    rambling,    one-story    structures. 
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which  are  very  attractive  but  at  the  same  time  very  costly. 
The  result  has  been  that  tax-rates  have  jumped  to  such  a  rate, 
to  meet  interest  on  the  bonded  indebtedness,  to  care  for  the  new 
improvements,  and  to  meet  the  upkeep  of  these  new  under- 
takings, that  the  people  last  year  elected  a  new  administration 
oledged  materially  to  cut  down  the  tax-rate,  and  these  men 
went  in  with  the  understanding  that  if  they  were  elected  they 
would  make  a  very  substantial  cut. 

The  school  department,  which  is  in  part  independent  of  th(> 
council,  but  in  some  features  has  to  go  to  the  council  for  additional 
funds,  employed  me  to  come  up  and  pass  on  three  things:  First, 
was  the  school  system  organized  so  as  to  get  the  most  efficient 
results?  Second,  was  the  scope  of  the  school  system  too  large, 
or  not  large  enough,  or  was  the  development  poorly  balanced? 
Third,  was  it  costing  as  much  as  it  ought  to  cost,  too  much,  or 
about  right?  The  report  which  I  wrote  for  them  was  published 
in  a  little  document  of  forty-eight  pages,  and  is  sold  by  the  board 
of  education  for  a  dime. 

I  took  16  western  cities  where  tax-rates  were  comparable, 
where  all  costs  for  city  expenses  were  comparable,  and  I  showed 
them,  by  the  comparative  method,  that  their  city  school  system 
vvas  below  the  median  compared  with  other  western  school 
systems.  I  showed  them  that  they  were  not  only  running  on  a 
lower  overhead  cost,  but  on  a  lower  percentage  for  supervision 
and  administration;  that  they  had  a  larger  number  of  children 
per  teacher  than  other  western  cities;  and  that  in  almost  every 
feature  of  the  administrative  organization  they  were  below  the 
median.  That  being  the  case,  they  could  hardly  be  accused  of 
extravagance. 

In  analyzing  the  scope  of  their  system  I  showed  them  that 
their  great  trouble  had  been,  as  far  as  education  was  concerned, 
that  up  to  relatively  recently  they  had  maintained  merely  a 
traditional  school  system,  with  only  the  elementary  schools  and 
a  high  school.  During  i-ecent  years  they  have  developed  a  good 
modern  school  system,  with  kindergartens;  intermediate,  technical, 
and  vocational  schools;  playgrounds;  good  athletic  work;  school 
oj-chestras;  and  other  educational  advantages.  The  result  has 
naturally  been  that  with  the  increasing  scope  and  effectiveness 
of  the  education  provided  there  has  l)een  a  marked  inci-ease  in 
its  cost. 

Another  good  illustration  which  I  can  give  you  is  the  city  of 
Salt   Lake,   in   Utah.      They   had   an   interesting   problem   there. 
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They  had  an  idea  that  their  schools  were  costing  them  a  great 
deal  of  money,  and  they  particularly  pointed  to  the  fact  that 
practically  40  per  cent  of  all  city  taxes  went  for  education,  and 
that  they  were  spending  $6.71  per  capita  for  schools,  whereas 
many  other  communities  were  spending  $4,  $4.50,  or  $5.  On 
the  face  of  it,  it  looked  rather  bad.  A  percentage  of  40  per  cent 
of  all  tax-rates  for  schools  is  large;  a  tax  of  $6.71  per  capita  is  also 
rather  large.  Such  would  exceed  not  only  most  eastern  cities, 
but  most  western  cities  as  well. 

I  had  a  feeling,  however,  after  I  had  looked  at  their  schools 
for  a  week,  that  there  was  something  wrong  in  the  figures;  there 
was  some  element  which  had  not  Ijeen  taken  into  consideration. 
Their  teachers  were  paid  but  a  small  amount;  15  per  cent  of  their 
teachers  were  working  for  less  than  $520;  and  they  wei-e  not 
spending  money  freely  anywhere  that  I  could  see.  Their  classes 
were  gradually  being  increased  in  size,  and  were  then  up  to  an 
average  per  teacher  of  43  children.  I  couldn't  understand  how 
they  were  spending  any  such  amount  of  money,  and  yet  the 
books  seemed  to  show  it.  When  I  analyzed  the  situation,  here 
is  what  I  found.  It  is  a  type  of  business  analysis  which  every 
superintendent  ought  to  make.  They  were  actually  spending 
$6.71  per  capita  for  schools;  the  average  for  16  western  cities 
was  only  $6.27;  the  median  for  16  western  cities  was  only  $5.73; 
39.1  cents  of  every  dollar  raised  ])y  taxes  in  the  city  went  for  the 
maintenance  of  the  schools.  In  the  matter  of  expenditure  the 
lowest  western  city  was  San  Francisco,  spending  $4.27  per  capita, 
and  the  highest  was  Pasadena,  which  has  an  extraordinarily 
expensive  school  system  at  $10.11. 

Let  me  take  it  another  way.  San  Francisco  was  spending 
11.9  per  cent  of  its  total  money  for  schools  for  the  year  that  I 
took;  Pasadena  was  spending  43.3  per  cent;  the  average  for  the 
western  group  was  32.2  per  cent;  the  median  was  31.8,  and 
Salt  Lake  City  was  spending  39.1.  I  then  hit  upon  the  clue  to 
the  whole  affair. 

I  began  to  investigate  how  many  children  there  were  in  Salt 
Lake  City,  compared  with  other  western  cities.  Western  cities 
ordinarily  do  not  have  very  many  children.  The  average  for 
the  entire  United  States  is  17.3  per  cent  of  the  population  between 
the  ages  of  5  and  15  years;  the  average  for  the  ordinary 
western  city  will  run  about  12  or  13  per  cent,  because  we  have 
so  many  unmarried  men  between  the  ages  of  25  and  45, — young 
fellows  who  have  come  west  and  have  not  as  yet  developed  a 
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family.  The  result  is  that  the  number  of  children  to  be  handled 
in  any  western  city  is  not  very  large.  San  Francisco,  for  example, 
has  11.9  per  cent;  Portland,  Ore.,  12  per  cent;  Sacramento, 
12  per  cent;  Seattle,  12.5  pen-  cent;  and  so  I  could  run  down 
thru  the  western  cities,  and  non(^  of  them  has  1")  pci-  cent  until 
I  strike  Salt  Lake  City,  which  has  18.5  pei-  cent,  ^i'hei'e  is  the  wiiole 
explanation.  With  Portland  at  12  prv  cent,  Salt  Lake  City, 
to  provide  merely  equivalent  schools  with  18.5  per  cent,  nuist 
spimd  a  little  over  50  per  cent  moi-c  money,  and  compared  with 
San  Francisco  at  11.9  per  cent,,  they  nuist  still  spend  a  trifle 
more  money. 

I  then  began  to  try  to  reduce  this  back  to  simple  terms.  What 
are  they  spending  for  each  1  per  cent  of  the  total  school  popula- 
tion? That  makes  a  very  much  better  statement,  and  wdien  I 
got  at  it  that  way,  Salt  Lake  City  was  spending  36  cents  for  each 
1  per  cent  of  the  total  population;  the  lowest  of  the  entire  list 
was  Tacoma,  at  32  cents;  the  highest  was  Pasadena  at  74  cents; 
the  median  for  the  western  cities  was  43  cents;  and  the  average 
was  45  cents.  With  Salt  Lake  City  at  35  cents  and  the  median 
43  cents,  you  have  the  deficit  at  once  of  7  cents  for  every  child, 
compared  with  just  the  median,  and  we  all  know  that  the  median 
represents  merely  average  conditions.  It  means,  in  other  words, 
there  are  as  many  school  systems  spending  more  as  there  are 
school  systems  spending  less. 

Taking  Salt  Lake  City  with  18.5  per  cent  of  the  population, 
it  is  spending  $6.71.  Figured  out  on  the  1  per  cent  basis,  and  the 
median  of  43  cents  as  a  desirable  expenditure,  it  should  be  spend- 
ing not  $6.71  per  capita  but  $7.96,  or  a  deficit  of  $1.25  per  capita 
of  the  total  population.  In  other  words,  multiplied  out,  it  would 
require  at  once  an  increase  in  the  school  expenditures  of  $137,500 
merely  to  bring  the  schools  of  Salt  Lake  City  up  to  the  median 
condition  for  western  cities.    You  can  easily  see  the  situation. 

I  then  proceeded  to  make  up  a  chart  which  would  show,  in 
picture  form,  what  rate  of  tax  on  the  $100  of  property  Salt  Lake 
City  would  need  to  raise  to  provide  the  same  kind  of  schools 
as  are  today  provided,  provided  it  had  the  same  percentage  of 
children  as  the  other  western  cities.  If  it  had  the  same  percentage 
of  children  as  San  Francisco,  for  example,  it  would  need  to  raise 
only  30.4  cents;  if  it  has  as  many  as  Spokane,  it  should  raise 
37  cents;  if  it  has  as  many  as  Los  Angeles,  33.2;  as  many  as  Fall 
River,  Mass.,  52.2.     Salt  Lake  City's  position  was  47.3. 

The  position  of  Salt  Lake  City  is  easily  shown  with  reference 
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to  the  question  of  children.  If  you  want  a  large  family,  all  right; 
but  don't  then  complain  because  it  costs  something  to  educate 
them.  If  a  city  wants  families  of  5,  G,  7,  and  8  children,  all  very 
well,  but  it  must  not  expect  to  get  off  on  the  same  kind  of  a  tax- 
rate  for  schools  that  a  city  of  small  families  does.  Such  western 
cities  as  Portland,  Los  Angeles,  and  San  Francisco  can  naturally 
maintain  their  schools  for  50  per  cent  less  money  than  can  the 
city  of  Salt  Lake;  or,  to  put  it  in  another-  way,  on  the  same  amount 
of  money  they  can  pay  50  ])er  cent  b(>tter  salaries  and  maintain 
a  50  per  cent  IxMter  school  system. 

Then  I  took  up  the  (juestion  of  what  they  needed  ttO  levy  to 
maintain  properly  their  schools,  and  pointed  out.  that  they  needed 
to  raise,  at  once,  something  like  $140,000  more  money  to  bring 
their  schools  up  merely  to  the  median.  If  they  wanted  to  provide 
adequately  for  their  schools  they  would  need  to  quit  entirely 
thinking  in  terms  of  how  nnich  per  dollar  they  were  spending, 
compared  with  other  cities,  and  to  substitute  how  much  they 
were  spending  for  each  1  per  cent  of  the  school  population.  In 
the  superintendent's  report  there  should  be  no  further  mention 
of  per  capita  cost,  but  instead,  how  much  the  schools  are  costing 
for  each  1  per  cent  of  the  children  to  be  educated.  An  earnest 
effort  should  be  made  to  get  the  people  to  see  the  need  of  bringing 
their  expenses  up  to  at  least  the  median  of  western  cities  in  the 
matter  of  each  1  per  cent  of  the  population. 

The  illustrations  I  have  given  you  will  reveal  the  kind  of  study 
which  can  well  be  made  in  a  comnumity  where  there  are  a  large 
number  of  children  to  be  educated,  and  where  people  are  con- 
tinually quoting  to  you  how  much  cheaper  per  capita  some  other 
community  is  educating  its  children  and  conducting  its  schools. 
You  must  think  in  terms  of  each  unit  of  your  school  population. 

Let  me  turn  now  to  another  phase  of  business  administration 
which  I  think  we  also  will  have  to  face,  and  that  is  the  question 
of  unit  costs.  What  is  it  costing  not  only  for  each  1  per  cent  of 
our  population,  but  what  is  it  costing  for  each  unit  of  everything 
else  that  we  have  or  use?  A  very  significant  study  has  recently 
been  made  by  the  director  of  the  Efficiency  Bureau  of  Kansas 
City,  Dr.  Melcher,  pubhshed  in  the  fifteenth  "Yearbook  of  the 
National  Society  for  the  Study  of  Education".  Mr.  Melcher 
shows  how  he  went  into  the  question  of  fuel  cost,  heating  cost, 
building  cost,  and  somewhat  into  study  cost.  A  still  more  in- 
teresting report,  in  some  respects,  is  that  which  has  just  been 
published  on  the  "Organization  and  Administration  of  the  School 
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City  of  Denver",  l)y  Dr.  Bobbitt,  in  which  he  analyzes  instruction 
cost  and  supply  cost  for  the  city  of  Denver  in  terms  of  units. 

Dr.  Melcher  found,  in  his  study  of  fuel  conditions,  that 
Kansas  City  showed  these  results.  First,  he  took  50  of  the 
largest  cities  of  the  United  States.  Of  course  different  climatic 
conditions  will  modify  fuel  costs,  but  such  ran  from  37  cents 
to  $2.70  per  pupil  per  year  for  fuel.  The  median  was  $1,325. 
Kansas  City  showed  a  variation  of  from  73  cents  to  $4.60,  with  a 
median  at  $1.62.  He  then  took  Kansas-Missouri-Iowa  cities, 
which  ran  from  70  cents  to  $2.09,  and  the  median  was  found 
to  be  $1.55.  The  costs  in  Kansas  City  may  be  perfectly  ex- 
phiinable.  There  may  be  nothing  the  matter  with  them,  but 
they  present,  nevertheless,  a  question  mark  that  the  efficiency 
expert  of  Kansas  City  is  looking  after. 

He  then  turned  to  Kansas  City  alone  and  took  up  the  different 
l)uildings  and  different  kinds.  Thirty-one  of  these  were  using 
oil  fuel;  33  buildings  were  using  soft  coal;  and  18  buildings  were 
using  anthracite.  The  oil  was  costing  from  99  cents  to  $4.08, 
with  a  median  of  $1.35;  soft  coal  was  costing  from  73  cents  to 
$4.90,  with  a  median  of  $1.83;  and  anthracite  was  costing  from 
96  cents  to  $4.56,  with  a  median  of  $1.92.  Now  there  isn't  a  great 
deal  of  difference  between  the  minima  and  the  maxima,  but  there 
is  a  big  difference  between  the  medians  and  the  maxima.  It 
is  a  perfectly  legitimate  question  to  ask  in  Kansas  City,  Are 
all  Iniildings  properly  heated?  Are  some  buildings  not  too  hot? 
It  is  also  a  perfectly  legitimate  question  to  ask,  Are  not  some  of 
these  l)uildings  pretty  poorly  constructed,  not  only  letting  in 
a  lot  of  cold  air,  but  perhaps  having  too  high  ceilings?  Are  the 
janitors  watching  the  schoolroom  temperatures?  Are  the  teachers 
watching  them?  As  Dr.  Melcher  points  out,  it  is  very  probal)le 
tiiat  if  this  study  were  followed  up,  and  the  janitors  were  given 
instructions  in  firing  and  temperature  rating,  they  could  save 
$10,000  a  year  on  their  fuel  bill.  If  so,  that  would  pay  for  their 
efficiency  bureau  about  three  times  over. 

Another  question  which  he  took  up  there  is  how  much  it  cost 
for  each  thousand  cubic  feet  of  air  that  is  heated.  Other  con- 
ditions will  now  come  in,  such  as  how  much  night  work  is  carried 
in  on  these  buildings?  How  much  are  they  used  ascomnmnity  cen- 
ters? We  ought  in  time  to  evolve  some  standards  by  which  such 
questions  may  be  answered. 

Turning  now  to  the  Denver  study,  I  want  to  consider  briefly 
another   type   of   cost   questions,   those   relating   to   instruction. 
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Professor  Childs  gave  you  some  statistics  of  this  type  this  morninji;. 
In  Denver,  figures  were  collected  to  show  what  it  cost  for  1,000 
hours  of  instruction  in  the  different  subjects  in  the  different 
high  schools  of  the  city.  In  the  West  Side  high  school  it  cost 
$1.32  for  1,000  hours;  in  the  East  Side  high  school,  93  cents; 
in  the  South  Side  high  school,  87  cents;  in  the  East  Eleventh 
school,  82.7  cents;  in  the  Manual  Training  high  school,  93  cents" 
and  in  the  North  Side  high  school,  (52  cents. 

These  figures  raise  a  number  of  interesting  (luestions.  Taking 
the  West  Side  high  school,  why  is  the  cost  so  high,  unless  this 
school  has  a  particularly  small  number  of  children  per  class,  or 
is  as  yet  an  undeveloped  school?  Some  reason  ought  to  be  sought 
as  to  why  instruction  costs  run  high  there.  There  is  also  a  similar 
question  as  to  why  instruction  costs  in  the  North  Side  high  s(;ho()l 
run  so  low.  It  may  be  that  this  is  inadequately  provided  with 
teachers,  or  that  this  school  may  even  be  too  expensive  to  retain. 

Turning  to  the  cost  of  instruction  per  student  hour  for  the 
different  subjects,  Dr.  Bobbitt  found  these:  Enghsh,  from  $53 
to  $65  per  1,000  hours;  mathematics,  from  $57  to  $79;  history, 
from  $46  to  $73;  modern  languages,  from  $72  to  $93;  science, 
from  .$43  to  $86;  drawing,  from  $50  to  $107;  and  Greek,  which 
was  offered  in  but  one  high  school,  was  costing  $322  per  1,000 
hours.  When  we  look  at  these  figures  the  wide  variations  in 
costs  naturally  raise  questions.  Perhaps  history  in  some  high 
schools  is  taught  too  cheaply;  perhaps  they  should  have  better 
equipment,  more  library  books,  and  perhaps  reduce  the  size 
of  the  classes  by  putting  in  more  history  teachers.  It  may  be 
that  the  modern  languages  are  taught  in  too  small  sections. 
It  may  be  that  you  can't  help  this.  Science,  which  we  expect 
to  be  expensive  because  of  laboratories  and  smaller  sections, 
is  not  expensive  at  all;  under  these  conditions,  apparently,  Denver 
could  push  science  instruction  in  high  schools  without  any  great 
cost.  Drawing  runs  up  a  little  but  is  not  particularly  high. 
Greek  is  the  expensive  luxury.  It  may  be  that  they  can  afford 
it,  but  it  may  be,  on  the  other  hand,  that  Greek  is  provided  at 
the  expense  of  other  things  in  the  system  which  are  more  vital. 
There  is  no  basis  for  throwing  Greek  out  on  its  high  cost,  but 
there  is  a  pretty  serious  basis  for  asking  Greek  to  stand  up  and 
prove  worthy  to  remain. 

Again,  in  pupil  supplies,  Dr.  Bobbitt  found  that  the  cost 
of  supplies  varied  from  6  to  25  cents  per  year  for  pupils'  supplies, 
a  median  of  12  cents;  textbooks  from  23  cents  to  83  cents;  with 
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a  median  of  47  cents;  and  supplies  used  by  the  teachers  in  instruction 
varied  from  13  cents  to  24  cents,  with  a  median  of  16  cents. 
From  such  figures  it  is  a  very  serious  question  if  all  of  these  schools 
are  not  being  undersupplied.  When  Dr.  Bobbitt  correlated  these 
figures  with  the  retardation  sheet  for  each  school,  he  found 
the  most  serious  cases  of  retardation  accompanied  the  lowest 
expenditure  for  supplies.  Instead  of  being  economical,  such  econ- 
omy is  frightfully  expensive.  It  means  unduly  increasing  the  re- 
peaters. Of  course  you  may  say  that  the  farther  down  in  the 
grades  you  keep  the  children  the  cheaper  it  is;  if  you  get  them 
along  they  only  get  into  high  school  and  cost  you  more  money; 
that  the  cheapest  grade  teachers  you  have  are  third  and  fourth 
grade  teachers,  so  keep  the  children  there  as  long  as  you  can. 
If  you  follow  this  argument  out  the  logical  thing  to  do  would  be 
to  abandon  the  public  schools  entirely,  and  turn  the  children 
over  to  private  and  parochial  schools  to  be  taught.  But  we 
didn't  start  our  schools  on  that  basis,  and  we  aren't  working 
on  that  basis,  and  if  you  look  at  the  question  from  any  point  of 
efficiency,  then  the  teaching  of  repeaters  is  a  frightfully  expensive 
piece  of  work.  As  citizens  and  tax-payers  we  have  the  right 
to  grumble  pretty  seriously  at  the  school  board  or  the  super- 
intendent who  allows  such  conditions  to  go  on. 

It  may  be  that  in  some  schools  we  are  spending  too  much, 
and  that  possibly  some  economies  could  be  made  in  some  places. 
On  the  other  hand,  it  may  be  that  the  whole  expenditure  is  too 
low,  and  that  everything  along  the  line  should  be  raised. 

Coming  back  to  what  I  said  in  the  beginning,  the  process 
of  education  is  primarily  the  business  of  spending  more  money 
in  a  better  way,  and  there  is  no  other  way  to  make  good  schools. 
You  must  get  at  the  process  of  spending  your  money  so  as  to 
make  both  sides  of  your  dollar  count,  and  get  the  maximum 
results  for  the  money  you  are  putting  in.  At  the  same 
time,  you  must  work  to  get  more  dollars  to  spend  to  increase 
the  value  of  j'^our  output. 

You  will  never  be  able  to  prove  your  needs  to  "the  man  in  the 
street",  or  to  the  man  on  the  council,  until  you  can  show  him, 
in  some  terms  that  he  can  understand,  that  you  are  getting  value 
received  for  the  dollars  he  gives  you.  If  you  tell  him  you  are 
producing  men  and  women,  that  you  are  doing  wonderful  work 
for  the  citizenship  of  our  republic,  and  that  you  arc  turning 
out  young  people  instilled  with  the  highest  ideals,  he  may  believe 
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you,  but  he  might  with  propriety  very  seriously  question  wliether 
you  know  what  you  are  talking  about. 

But  if  you  can  prove  to  him  that  you  are  getting  good  instrue- 
tion  along  certain  lines;  that  you  have  averaged  up  the  cost  so 
that  you  haven't  any  big  extremes;  that  if  you  had  some  more  dol- 
lars, a  certain  added  percentage  to  put  on  your  funds,  you  could 
do  so  much  more  with  it,  then  you  have  some  basis  on  which  ti) 
talk.  Generally  what  happens  is  this:  The  school  budget  sent 
up  to  a  city  council  asks  for,  say  $73,000  more  than  co  t'.  jiad  last 
year,  but  with  no  clear  statement  of  why  you  need  this  amounl  ; 
no  statement  of  added  needs;  no  statement  as  to  unit  (U)sts  tfoui 
which  added  expenditures  have  been  calculated;  and  little  upon 
which  a  councilman  can  estimate  th(»  business  efficiency  of  a 
school  system. 

It  is  something  of  this  type  of  accounting  that  you  \v:ll  have 
to  face  in  your  business  relations.  In  your  State  of  Indiana,  for  ex- 
ample, very  few  of  your  cities  publish  an  annual  report  at  all,  and  I 
think  one  reason  why  the  superintendent's  pay  in  Indiana  is 
lower  than  it  is  in  adjoining  States,  one  reason  why  you  liave 
more  difficulty  in  getting  money  for  your  teachers'  salaries,  one 
reason  why  you  have  difficulty  in  getting  more  money  for  ex- 
pansions, is  that  you  don't  tell  the  people  what  you  are  doing 
and  of  your  needs  by  publishing  an  annual  report.  Once  each  ycai- 
you  should  render  in  print  an  account  of  your  stewardsiiip;  as 
manager  of  the  business  you  should  report  to  your  board  of 
directors,  and  thru  them  to  the  stockholders  of  the  corporation, 
telling  them  what  you  have  done  with  the  money  they  gave  you 
last  year,  and  how  much  more  you  could  do  if  they  would  give 
you  more  next  year.  Only  on  some  such  basis  can  we  safely  face 
the  question  of  increasing  cost,  the  question  of  higher  interest 
rates,  the  question  of  the  greater  struggle  for  city  funds.  Unless 
this  question  of  finance  is  faced  intelligently  and  in  a  truly  business- 
like manner,  I  think  many  su])erintendents  of  schools  are  headecl 
for  trouble. 


Principles    of   Scale    Derivation   with   Special 

Application  to  Arithmetic,  Geography, 

History,  and  Grammar 

BnrcE  R.  Buckingham,  Educational  Statistician  for  the  State  of  Wisconsin 


The  subject  of  the  report  which  I  bring  ta  you  this  morning 
is  a  rather  ambiguous  one.  We  all  know  that  at  a  certain  point 
in  any  development  there  comes  along  a  theory  to  justify  the 
cruder  practice  which  has  hitherto  characterized  it.  It  has  seemed 
to  me  that  there  is  emerging  a  theory  in  the  matter  of  scale  deriva- 
tion, and  that  if  we  can  apply  it  we  shall  be  able  to  derive  scales 
of  much  greater  richneas  and  compass,  and  in  much  greater 
numbers  than  we  have  been  able  to  derive  them  hitherto. 

Not  long  after  I  became  connected  with  the  superintendent's 
office  at  New  York,  I  was  asked  to  undertake  an  investigation 
of  the  academic  teaching  in  the  fundamental  subjects  in  different 
types  of  elementary  schools.  The  opportunity  which  this  offered 
of  putting  into  practice  the  application  of  experimental  methods 
to  the  elucidation  of  particular  educational  problems  made  the 
project  seem  to  me  very  attractive.  The  subjects  in  which  it  was 
decided  to  test  the  children  were  arithmetic,  spelling,  geography, 
history,  and  English  grammar.  The  seventh  and  eighth  grades 
of  sixteen  schools  were  examined  on  March  13  and  14,  1915. 
On  June  15  and  16,  1915,  they  were  again  tested  in  the  same 
subjects  with  material  which  was  designed  to  be  of  the  same 
difficulty  as  that  of  the  material  used  in  March. 

I  take  it  that  any  testing  which  is  carried  out  upon  a  scientific 
basis  must  be  composed  of  three  rather  definitely  fixed  lines  of 
activity.  There  must  be  a  preliminary  test,  when  material  is 
evaluated,  conditions  are  estimated,  and  the  general  attitude 
of  the  experimenter  and  the  subject  is  determined.  Ordinarily 
the  material  derived  fr(Hn  this  preliminary  test  will  not  be  used. 
Then  there  is  the  real  test,  the  one  for  which  the  preliminary  test 
was  a  preparation.  This  constitutes  the  basis  of  the  report. 
The   answer  to   the   (luestion  is   derivcnl   from   it.      And.   thirdly, 
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there  is  the  control  test  whereby  conditions  are  set  over  against 
conditions  in  such  a  way  that  comparison  is  possibk\ 

Now  in  the  testing  of  these  schools  in  New  York  City  the 
preliminary  test  was  occupied  with  an  evaluation  of  the  material 
to  be  used.  The  particular  object  was  to  obtain  a  certain  paral- 
lelism of  the  tests.  For  the  purpose  that  I  had  in  mind  a  progress 
record  between  March  and  June  could  not  be  obtained  unless  we 
couhl  use  material  the  diflfieulty  of  which  was  known  and  pre- 
ferably known  to  be  of  equal  difficulty.  Accordingly,  a  large  num- 
ber of  questions  was  used  in  an  attempt  to  evaluate  material 
for  these  different  school  subjects.  The  real  test  consisted  of  the 
application  of  a  selection  from  liiese  (piestions  to  the  experimental 
schools  in  New  York,  of  which  there  were  8;  and  the  control 
test  was  represented  by  the  administering  of  the  same  test  ma- 
terial to  8  other  schools  pursuing  the  regular  course  of  study. 

The  number  of  ])articipants  in  the  real  test  was  about  ten 
thousand  both  in  March  and  in  June,  and  the  number  of  par- 
ticipants in  the  preliminary  test  differed  greatly  for  different  kinds 
of  material.  I  am  not  giving  you  any  report  here  for  the  pre- 
liminary test,  nor  am  I  giving  you  any  report  of  the  spelling  test. 
Ten  questions  were  given  in  arithmetic  in  March  and  10  in  June. 
You  will  find  those  10  questions  in  March  on  the  first  page  of 
the  material*  you  have  in  your  hands,  and  the  ten  problems  for 
the  June  test  are  on  the  second  page.  In  geography  there  were 
40  questions  given  in  the  real  test.  These  occupy  pages  3  and  4. 
In  history  there  were  24  questions;  and  in  English  there  were 
28,  except  for  the  fact  that  in  the  first  half  of  the  seventh  grade 
only  20  questions  were  given. 

At  this  point  permit  me  to  digress  momentarily  to  say  that 
there  a  great  many  situations  similar  to  the  one  which  I  am 
here  reporting.  Tests  are  no  new  things  and  I  fancy  that  in 
looking  at  these  questions  they  will  appear  to  you  to  be  not  greatly 
different  from  the  tests  which  you  have  been  familiar  with  as 
teachers  and  supervisors.  They  are  instruments  that  have  been 
used  by  teachers  and  supervisors  time  out  of  mind.  Every  year, 
in  most  places  every  half-year,  and  in  many  instances  more 
frequently,  children  are  tested  in  a  number  of  subjects  with  the 
idea  of  finding  out  how  they  are  maintaining  themselves  or  whether 
they  ought  to  be  promoted  or  not.  The  particular  and  temporary 
need  having  been  served,  the  material  and  the  results  have  reached 


*For  material  referred  to  see  Appendix. 
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the  waste  basket.  It  is  no  doubt  true  that  if  the  material  which 
is  so  (Hsposed  of  in  a  sinj2,1e  week  in  our  schools  could  be  gathered 
togethei'  it  would  make  th(>  most  im})ortant  contribution  to 
(Mlucation  that  could  be  devised.  Effort  without  knowledge  of 
results,  blind,  wasteful,  trial-and-error  methods  nuirk  the  progress 
of  the  young  teacher  who  faces  problems  unaided,  i)ecause  thou- 
sands of  jx'ople  who  have  solved  them  before  h(>r  have  not  thought 
it  worth  whih^  to  save  their  results. 

To  turn  to  the  tests  as  they  were  given  in  New  York.  More 
than  20, 000  returns  were  received  in  the  March  and  June  tests 
taken  together  in  each  subject,  or  100,000  papers  in  all.  This 
involved  the  examination  of  200,000  answers  in  arithmetic, 
400,000  in  geography,  240,000  in  history,  280,000  in  grammar,' 
and  1,000,000  words  in  spelling.  It  is  from  this  material  that  I 
]n-o]iose  to  oft'er  today  scales  for  measuring  attainment  in  each 
of  the  subjects  except  spelling,  as  far  as  the  relatively  small  numl)er 
of  questions  permits  this  to  be  done. 

At  the  outset  permit  me  to  state  the  way  in  which  the  questions 
were  selected.  A  previous  study  of  spelling  gave  a  hint  as  to 
method.  In  the  rating  of  spelling,  each  form  is  either  right  or 
wrong,  and  it  has  never  been  customary  to  allow  part  credits 
for  words  only  slightly  misspelled.  It  occurred  to  me  that  the 
same  procedure  could  be  followed  in  other  subjects,  provided  a 
standard  for  each  question  coud  be  set  up  such  that  failure  or 
success  in  reaching  it  could  be  accurately  determined.  Under 
such  circumstances  each  child's  answer  to  a  question  might  be 
rated  as  right  or  wrong  (perhaps  satisfactory  or  unsatisfactory 
would  be  a  better  term),  and  no  part  credits  for  partial  success 
need  be  allowed.  This  method  presented  no  particular  difficulty 
in  arithmetic.  In  the  content  subjects,  however,  of  geography, 
history,  and  English  grammar,  the  task  was  not  so  easy.  It  is 
clear  that  the  method  of  right  and  wrong  cases  may  be  much 
more  easily  applied  in  the  content  subjects  to  the  more  formal 
aspects  of  them.  It  is  clear  that  each  of  these  content  sul)jects 
has  a  body  of  facts  connected  with  it  about  which  there  is  little 
or  no  dispute.  Answers  to  questions  a1)Out  these  facts  may, 
with  propriety,  be  rated  either  as  right  or  wrong;  and,  concerning 
the  answers,  no  one  who  is  informed  can  be  in  doubt  as  to  whether 
they  are  right  or  wrong. 

I  realize  that  you  will  feel  some  disappointment  that  geography, 
history,  and  grammar  have  been  treated  only  in  their  more  formal 
aspects — that   is,   that   (questions   are   of  the   informati«nial   type 
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almost  exclusively.  I  do  not  believe,  however,  that  this  affords 
justification  for  any  feeling  as  to  the  limitations  of  the  test 
method  when  applied  to  content  subjects.  There  are  three  reasons 
why  this  appears  to  me  to  be  true. 

In  the  first  place,  there  are  parts  of  every  fundamental  scliool 
subject  which  are  so  fundamental  that  ignorance  of  them  is  a 
misfortune,  and  the  various  States  have  d(>fined  what  the  common 
school  education  shall  be.  They  have  defined  it  in  terms  of 
fundamental  parts  of  fundamental  subjects,  and  tliey  certainly 
contemplate  that  the  child  shall  be  informed,  shall  know,  shall 
remember,  if  you  please,  these  fundamental  parts  of  fundanunital 
subjects.  The  world,  rightly,  I  think,  judges  praise  to  the  well 
informed  per,son,  and  when  you  find  the  business  man  criticizing 
the  schools,  you  generally  find  him  doing  it  on  the  basis  of  things 
that  children  don't  know. 

In  the  second  place,  we  need  to  be  little  disturbed  about  the 
fact  that  these  questions  are  information  questions  because  there 
is  a  direct  relationship  between  information  and  thought  in  any 
given  field.  Those  who  do  well  in  an  information  test  will  also 
do  well  in  a  test  requiring  inference  or  deduction.  Just  before 
I  left  New  York  I  gave  an  informational  and  a  thought  test  in 
history  to  the  same  groups  of  children.  I  have  not  completely 
worked  out  the  conclusions  yet,  but  the  correlation  coefficient 
between  information  ratings  and  thought  ratings  is  unques- 
tionably positive  and  high.  If  further  study  of  the  matter 
confirms  this,  the  reliability  of  information  tests  as  indirect 
measures  of  total  ability  within  the  field  in  question  be- 
comes apparent.  The  doctrine  of  indirect  measurement  is 
no  new  thing.  For  a  long  time  we  measured  fatigue  by 
measuring  the  distance  between  the  points  of  the  aesthesio- 
meter,  and  altho  the  correspondence  between  cutaneous 
insensitivity  ,and  fatigue  has  been  more  or  less  discredited 
it  wasn't  discredited  on  the  ground  that  the  fatigue  ele- 
ment could  not  be  measured,  provided  there  was  a  cor- 
respondence. The  method  of  indirect  measurement  is  well 
illustrated  by  the  thermometer;  we  don't  measure  the  heat,  we 
measure  the  height  of  the  mercury  column,  which  varies  directly, 
or  nearly  so,  with  the  heat.  It  is  not  always  necessary  to 
measure  directly  the  thing  we  want  to  know  about,  but  it  is 
sometimes  possible  to  measure  a  thing  which  varies  with  it  and 
which  in  itself  is  much  more  easily  measured  than  is  the  thing 
which  we  want  to  know  about. 
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In  the  third  place,  it  is  possible  to  develop  a  technique  with 
respect  to  thought  questions  whereby  they  may  be  handled  in 
practically  the  same  way  that  these  information  questions  were 
handled  in  the  work  at  New  York.  I  can  only  suggest  the  lines 
along  which  this  development  may  take  place.  The  first  need 
is  to  secure  a  judgment  as  to  the  value  of  certain  types  of  answers. 
Sup])ose  that  the  question  is  the  following:  "Check  the  five  most 
important  topics  in  the  following  list:  Paul  Revere's  Ride; 
The  Purchase  of  Alaska;  The  Discovery  of  Lake  Champlain; 
.John  Brown's  Raid;  The  Aloiiroe  Doctrine;  The  Capture  of 
Alajor  Andre;  The  Visit  of  Lafayette  to  the  United  States; 
Magellan's  Voyage  Around  the  World;  The  Boston  Tea-Party; 
Construction  of  the  Panama  Canal;  Washington's  Journey  to 
P'ort  Dequesne;  Sheridan's  Ride;  The  Purchase  of  Louisiana; 
Making  of  the  First  American  Flag  by  Betsy  Ross."  This  is 
clearly  a  matter  of  judgment.  The  answer,  from  one  point  of 
view,  must  be  regarded  as  correct,  no  matter  what  it  is.  Betsy 
Ross  and  the  American  Flag  may  be  allowed  to  vie  in  importance 
with  the  Monroe  Doctrine  and  the  Louisiana  Purchase,  but  most 
of  you  if  you  were  rating  answers  to  this  question  would  feel 
that  the  child  who  checked  "Betsy"  was  not  entitled  to  as  much 
credit  as  another  child  might  be  who  refrained  from  doing  so. 
Just  where  one  might  draw  the  line  and  say  that  this  topic  or 
that  should  not  be  included  among  the  five  most  important 
is  a  question  which  all  of  you,  I  am  sure,  would  feel  to  be  difficult. 
You  would  feel  that  any  decision  on  your  part  might  be  arbitrary 
and  somewhat  indefensible.  To  set  up  the  judgment  of  one  person 
against  another  is  repugnant  to  our  ideas  of  proper  procedure. 
We  do  not,  however,  feel  this  compunction  to  such  a  degree 
Avhen  we  find  that  another  person  agrees  with  us  in  our  judgment; 
and  if  we  find  yet  others  in  agreement  with  us,  our  opinion  deepens 
into  conviction  and  we  reach  a  point  where  we  feel  almost  as  certain 
of  our  ground  as  we  would  l)e  in  the  case  of  an  answer  to  a  fact 
question  such  as:  "In  what  war  was  the  l^attle  of  Gettysburg 
fought?"  What  I  am  coming  to  is  this:  It  is  quite  ])<)ssi])le  to  se- 
cure the  judgments  of  competent  persons  as  to  typical  answers, 
and,  liaving  secured  a  concensus,  to  use  the  c(msensus  in  the 
same  way  that  facts  are  used  in  the  rating  of  information  (jues- 
tions. 

It  may  seem  that  the  inferential  question  which  I  have  used 
as  an  illustration  is  of  a  peculiar  tyi)e  which  may  lend  itself  to 
treatment  by  the  method  of  right  and  wrong  cases  more  rea(Uly 
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than  would  most  questions  requiring  a  pu])il  to  (^xercise  individual 
thought.  No  one  would  deny,  I  should  suppose,  that  the  ({ualitic^s 
of  judgment  and  estimate  of  values  called  for  in  the  (juestion  about 
ehecking  the  five  most  important  historical  topics  are  among  tlu; 
(jualities  which  we  most  desire  to  cultivate  in  our  school  work. 
There  are,  however,  many  other  types  of  mental  processes  which 
it  is  equally  desirable  to  train  and  fostei-. 

Let  us  therefore  take  anotlun-  illustration  which  will  pi'ob- 
ably  i)reseiit  as  much  difficulty  in  the  application  of  1he 
method  of  right  and  wrong  cases  as  aii>-  that  would  l)e  likely 
to  be  used.  8ui)])ose  the  (pu^stion  to  be:  "Account  for  the 
fact  that  the  climate  just  (>ast  of  the  Rocky  Mountains  is 
unusually  dry."  T  have  actually  used  this  (piestion  and 
have  found  it  quite  ])racticable  to  rate  it  as  either  right  or 
wrong  without  allowing  part  credits,  provided  the  necessary  pre- 
liminary judgments  are  secured  as  to  what  characterizes  a  satis- 
factory answer.  Taking  a  rather  wide  selection  of  answers  at 
random  one  may  manifold  them  and  issue  them  to  a  number  of 
comp(>t(>nt  judges.  From  the  returns  which  I  myself  received 
regarding  this  question,  it  did  not  prove  to  be  difficult  to  formu- 
late satisfactory  answers,  or  i-ather  elements  necessary  to  a  satis- 
factory answer.  This  docs  not  mean  that  only  one  answer  was 
accepted  as  correct.  According  to  the  judges,  several  sorts  of 
answers  would  be  acceptable,  involving  different  elements  more 
or  less  expressly  stated,  such  as  th(^  fact  that  the  west  winds 
are  saturated  with  moisture;  that  the  mountains  act  as  barriers; 
that  the  air  in  rising  over  the  mountains  is  cooled,  thereby  pre- 
cipitating its  moisture^;  that  the  winds  from  other  directions  than 
the  west  have  been  deprived  of  their  moisture  before  reaching 
this  region  "just  east  of  the  Rocky  Mountains".  The  procedure 
in  thus  standardizing  answers  to  thought  questions  is  rather 
tedious;  but  it  is  perfectly  practicable  and  surprisingly  satis- 
factory if  the  number  and  importance  of  the  preliminary  judg- 
ments are  sufficient.  I  think,  therefore,  that  we  are  ready  to  set 
up  scales  and  standards  of  achievement  in  content  subjects, 
and  I  think  that  it  will  be  done  along  the  line  which  I  have  sug- 
gested, and  one  phase  of  which  I  shall  illustrate  in  this  report. 

The  whole  theory  of  scale  derivation  has  taken  on  form 
and  substance.  It  is  apparent,  for  instance,  that  there  are  two 
methods  developing  in  scale-making,  viz.,  the  judgment  method 
which  Thorndike  and  Hillegas  followed  in  penmanship,  drawing, 
and  composition,  and  the  ratio  method  which  I  used  in  spelling 
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and  which  has  since  been  followed  by  Ayers  in  the  same  subject 
and  by  Trabue  in  language  and  Starch  in  arithmetic. 

It  may  readily  be  shown  that  the  school  subjects  are  sus- 
ceptible of  arrangement  in  a  certain  serial  order  which  will  indicate 
the  methods  of  scale  derivation  applicable  to  them.  At  one  end 
of  the  series  will  be  such  subjects  as  spelling  and  arithmetic, 
which  lend  themselves  particularly  well  to  the  ratio  method, 
that  is,  to  the  expression  of  the  relation  between  the  actual  number 
of  correct  responses  and  the  possible  number  of  correct  responses. 
At  the  other  end  of  the  series  are  such  subjects  as  composition 
and  penmanship.  Scales  for  these  subjects  must  be  derived  by 
the  judgment  method.  One  sample  of  handwriting  is  better 
than  another,  not  as  a  fact  but  as  an  opinion.  A  specimen  of 
English  writing  is  better  than  another,  precisely  because  com- 
petent people  think  it  is  better.  Between  the  extremes  of  the 
school  subjects  (represented  on  the  one  hand  by  arithmetic 
and  spelling,  and  on  the  other  hand  by  composition  and  pen- 
manship) are  a  number  of  subjects  to  which  the  ratio  method  and 
the  judgment  method  may  both  apply,  according  to  the  material 
wdiich  enters  into  the  scales  to  be  derived.  Geography  and 
history  may  typify  these  intermediate  subjects.  That  there  are 
parts  of  these  fields  so  precise  and  unequivocal  as  to  lend  them- 
selves to  the  same  sort  of  treatment  that  may  be  given  to  spelling, 
no  one  will  doubt  who  reads  the  geography  and  history  questions 
wdiich  you  have  in  your  hands.  As  to  the  parts  of  these  intermed- 
iate subjects  which  are  not  so  definite,  the  judgment  method 
may  play  an  important  role.  It  may  do  so  on  the  one  hand 
purely  on  the  analogy  of  the  judgment  method  used  in  the  deriva- 
tion of  the  Thorndike  handwriting  scale;  that  is,  it  may  simply 
employ  the  theorem,  "Differences  wdiich  are  equally  often  noticed 
are  equal."  Answers  to  questions  in  geography,  history,  science, 
or  literature  will  then  be  judged  pair  by  pair  as  to  differences  in 
merit,  and  scaled  directly  as  a  result  of  such  judgment.  This 
method  is  perfectly  feasible,  and  there  are  no  doubt  parts  of 
these  subjects  which  will  be  best  scaled  in  this  manner.  Or,  on 
the  other  hand,  the  judgment  method  may  be  applied  in  con- 
junction with  the  ratio  method  in  some  such  way  as  I  have  in- 
dicated above,  that  is,  by  securing  a  basis  of  judgment  as  to 
the  Tightness  of  the  answers. 

Thus  you  will  see  that  I  do  not  think  that  the  limits  of  scale 
derivation  have  been  reached;  indeed,  I  do  not  think  we  have 
much  more  than  embarked  upon  this  particular  phase  of  educa- 


56  Bulletin  of  the  Extension  Division 

tional  inquiry.  We  shall  have,  before  long,  scales  in  all  school 
subjects,  and  not  merely  one  but  many  in  each  subject.  For  in- 
stance, we  shall  have  for  spelling  not  only  a  general  scale  but  one 
for  each  grade.  In  arithmetic  we  shall  have  a  variety  of  scales, 
not  only  those  for  each  grade,  l)ut  those  for  oral  and  written  work, 
abstract  work,  and  probhnus.  In  coin])osition  we  shall  have 
scales  not  only  for  each  grade,  Ijut  also  for  the  different  types  of 
discourse  and  for  letters  of  various  kinds.  The  movement,  there- 
fore, for  standardization  is  only  in  its  infancy.  To  my  mind  it 
is  one  of  the  most  hopeful  movements  in  education.  It  is  un- 
necessary for  me  to  enlarge  upon  this  point  to  an  assemblage 
gathered  under  auspices  such  as  these.  I  think,  however,  that  our 
supervision  will  be  vastly  improved  by  it;  that  our  children  will 
be  more  rapidly  and  effectively  taught;  that  inefficient  teachers 
will  no  longer  be  able  to  hide  behind  our  ignorance;  and  that  the 
far-off  and  dubious  aim  of  education — an  aim  too  remote  to  be 
effective  to  the  general  practitioner — will  be  replaced  by  a  goal 
which  is  in  sight,  by  a  motive  which  is  dynamic  and  energizing,  and 
by  an  appeal  which  is  not  a  generalization  nor  a  hope  deferred, 
but  an  example  of  what  pupils  have  actually  done — an  example 
so  concrete  that  it  cannot  be  misunderstood,  so  obvious  that  it 
cannot  ])e  dodged,  and  so  fair  and  impartial  that  it  cannot  be 
resented. 

It  is  exceedingly  important  that  the  exact  procedure  in 
administering  of  these  tests  should  be  set  forth,  but  to  arrive  at 
the  scales  themselves  this  morning  it  will  probably  be  necessary 
for  me  to  take  this  up  at  the  round  table  this  afternoon,  should 
you  want  me  to  do  so.  It  makes  a  whole  lot  of  difference  how  the 
tests  are  given.  It  makes  a  whole  lot  of  difference  how  they  are 
rated,  and  if  you  are  going  to  go  back  to  your  homes  and  use 
any  of  these,  you  should  know  how  it  is  done;  not  that  my  way 
is  any  l)etter  than  your  way  would  be,  but  it  may  be  different. 
The  test  papers  were  sent  out  by  the  city  superintendent  to  the 
principals  with  instructions.  At  the  central  office  when  the 
papers  were  returned,  after  having  been  rated  by  the  teachers, 
according  to  instructions,  they  were  re-rated  on  a  one-fifth 
random  sample  basis.  If  after  selecting  one-fifth  of  the  papers, 
the  number  of  reversals  of  a  teacher's  ratings  was  less  than  3 
per  cent  of  the  questions  rated,  the  set  was  considered  to  have  been 
satisfactorily  handled  by  the  teacher.  If  there  were  more  than 
3  per  cent  of  reversals,  an  additional  one-fifth  of  the  papers  were 
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selected,  and  if  there  were  not  then  less  than  3  per  cent  of  reversals, 
the  ])apers  were  sent  hack  to  the  school  for  re-rating- 

As  indicalinji;  the  value  of  the  aritlinu>tic  material  for  test 
jnirposes,  1  call  your  attention  to  this  Figure  I,  which  shows 
the  frequency  of  the  ratings  in  the  two  halves  of  the  seventh  grade 
in  the  March  test.  You  will  notice  that  in  the  seventh  grade, 
first  half,  there  were  many  children  who  were  unable  to  get  a 
single  example  right.     This  horizontal  scale  is  for  the  numbers 
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Fig.   I.     Frequency  of  Arithmetic  R.\tings:     Per  Cent  of  Questions 
Answered  Correctly. 


of  ])roblems  solved  correctly;  the  vertical  scale  is  for  ])er  cents 
of  children  who  solved  them  correctly.  About  13  per  cent  of 
the  lower  seventh  grade  children  were  unal)le  to  solve  a  single 
example.  The  test  material  in  arithmetic,  therefore,  was  not 
id(>ally  adapted  to  the  lower  seventh  grade  because,  of  course, 
there  is  a  wide  variety  of  ability  among  these  thirteen  children 
out  of  one  hundred,  none  of  which  is  tested  because  they  all  get 
the  same  rating. 

The  situation  is  a  little  better  in  the  seventh  grade,  second 
half.  We  have  a  surface  of  frequency  which  approaches  more 
nearly  the  normal  type,  the  children  who  did  very  poorly  IxMug 
more  nearly  balanced  by  those  who  did  very  well.  The  median 
in  the  lower  seventh  grade  was  3%  examples  done  correctly  out 
of  10;  in  the  upper  seventh  grade  it  was  exactly  5  examples. 

Figure  II  is  for  the  March  test  in  arithmetic  in  the  lower 
eighth  and  upper  eighth  grades.  The  surface  is  only  fairly  satis- 
factory for  the  upper  eighth.  Note  the  piling  up  of  thecliildren 
at  the  u])per  i^wd.     The  medians  are:    for  lower  (>ighth  grade,  6.2 
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problems  answered  correctly;  for  the  u])|)(>r  <i;ra(le,  7. S  answered 
correctly. 

Permit  me  to  remind  you  that  this  should  be  taken  with  some 
degree  of  caution.  The  problems  are  not  of  (^qual  difficulty. 
Whenever  any  showing  such  as  this  is  made,  or  any  tabular  show- 
ing concerning  the  number  of  examples  correct  or  questions  correct, 
or  items  of  a  test  correctly  solved,  the  elements  (here  the  problems) 
are  found  to  be  decidedly  uneciual  in  difficulty.  A  tabulation  or 
a  gra])hi('  showing,  however,  of  the  personal  scores  of  children, 
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Answered  Correctly. 


if  we  understand  that  it  does  not  mean  what  it  appears  to  mean — 
viz.,  that  the  jiroblems  are  of  equal  difficulty — -iS  useful,  because, 
taken  as  a  total  measuring  instrument,  a  group  of  ten  problems 
such  as  you  have  h(>re  does  have  value  for  the  comi)arisoii 
which  it  enal)les  you  to  make  l)etween  conditions  in  one  place 
and  conditions  in  another.  The  thing  that  we  must  look  out  for 
is  that  we  do  not  judge  that  a  child  who  answers  6  problems 
correctly  does  three  times  as  good  work  as  does  the  child  who 
answers  2.     We  must  make  no  such  comparisons. 

Before  I  show  you  any  of  the  scales  for  the  school  subjects 
under  discussion  it  will  be  necessary  for  me  to  give  you  a  brief 
statement  of  the  way  in  which  the  ratio  method  of  scale  deriva- 
tion is  applied.  The  fundamental  assumption  is  that  the  ability 
of  jjupils  in  each  grade  is  approximately  of  the  normal  type. 

Figure  III  will  give  you  an  idea  of  the  idealized  surface  of 
frequency  which  is  commonly  called  normal.  As  I  have  experi- 
mented and  studied  the  question  of  the   distribution  of  ability 
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among  school  children  I  have  come  more  and  more  strongly 
to  the  opinion  that  this  is  the  true  pictorial  representation  of  the 
distril)ntion;  in  other  words,  I  believe  that  the  distribution  of 
ability  in  each  grade  is  substantially  of  the  normal  type,  aEd  I 
do  not  arrive  at  that  from  any  hasty  conclusion  or  from  any 
desire,  great  tho  it  may  be,  to  use  the  frequency  surface  of  the 
normal  type  on  account  of  its  simplicity.  As  some  of  you  perhaps 
remember,  I  experimented  rather  fully  a  few  years  ago  with 
distributions  of  an  asymmetrical  character  and  the  results  were 
almost  negative.  It  appears  that  the  eliminative  process  which 
is  going  on  in  the  public  schools  from  the  lower  grades  to  the 
upper  grades  does  not  skew  the  distribution  to  any  important 
degree.    It  simply  moves  it  up. 
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Pig.  III.     Normal  Surface  of  Frequency. 


The  theory,  therefore,  upon  which  these  scales  are  derived 
is  based  upon  the  assumption  of  a  normal  distribution  of  ability. 
When  we  say  that  a  cpiestion  in  geography  or  a  problem  in  arithmetic 
is  answered  by  50  per  cent  of  the  children,  we  mean  that  half  of 
the  children  possess  such  ability  as  is  necessary  to  answer  the 
cjuestion  or  more  ability  than  is  necessary  to  answer  it.  Ability  is 
measured  along  the  base  line  of  the  figure;  low  ability  being  at 
left  and  high  ability  at  the  right;  and  the  a])ility  corresponding 
to  a  50  per  cent  problem  would  be  presented  by  such  a  point  on 
the  base  line  as  would  leave  half  the  area  of  the  surface  to  the 
right  of  its  perpendicular,  the  right  being  the  high  ability  end. 
It  would  be  located  here  at  zero  (indicating)  and  this  would  be 
the  perpendicular.  Half  the  surface  of  the  figure  is  to  the  right 
of  the  perpendicular. 

Suppose  that  the  problem  were  answered  by  only  25  per  cent  of 
the  children  of  a  grade.     The  placing  of  this  problem  would  be  at 
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a  point  on  the  base  line  to  the  right  of  which  only  25  per  cent  of 
the  area  of  the  normal  surface  lies.  Such  a  point  would  be  placed 
here  (indicating),  and  the  distance  from  the  median  ability  to  this 
point  is  by  definition  the  "i)robable  error"  of  the  curve.  The 
probable  error,  then,  is  the  distance  from  the  median  to  a  point  on 
the  base  line  at  which  a  per])endicular,  if  erected,  will  cut  off  25 
per  cent  of  the  area.  This  distance  is  our  unit,  and  all  measures 
of  ability  as  shown  in  the  following  scales  are  in  terms  of  it. 

A  question  answered  by  75  per  cent  of  the  i)upils  of  a  grade; 
would  be  placed  here  (indicating)  where  the  perj)endicular  would 
leave  75  i)er  cent  of  the  area  to  the  right.  This  would  be  at  —  I 
P.E.  A  question  answered  by  91  per  cent  of  the  children  would 
be  here,  at  about  +2  P.E.  (indicating).  Any  given  percentage 
has  its  point  on  the  base  line,  a  perpendicular  at  which  leaves 
to  the  right  that  same  percentage  of  the  area.  In  our  work  the 
area  to  the  right  of  such  a  per])endicular  represents  the  proportion 
of  pupils  whose  ability  is  such  that  they  can  ans\ver  the  (piestion 
correctl}^ 

The  diagram  which  I  now  show  you  ( l^'igui-c  1\')  is  a  series 
of  scales  for  the  difficulty  of  20  ]irol)lems  in  arithmetic.  Tlnn'e 
are  5  scales,  one  for  each  of  the  4  highest  half-yearly  grades  of 
the  elementary  school,  and  1  general  scale  for  the  4  grades  com- 
bined. The  series  of  numbers  at  the  top  of  tiie  diagram  (indicat- 
ing) are  P.E.  units  multiplied  by  100.  That  is  to  say,  180  means 
1.80  P.E.  The  questions  are  indicated  by  numl)ers  along  the 
scales  and  under  the  P.E.  value  to  which  they  belong.  If  the 
diagram  were  comi^lete  there  would  be  erected  on  the  entire 
top  line  a  very  large  normal  surface  of  frecpiency  whose  highest 
ordinate  would  be  at  zero,  and  25  per  cent  of  whose  area  would 
lie  to  the  right  of  +100,  with  75  per  cent  to  the  right  of  —100. 

Notice  that  the  numbers  below  each  scale  line  are  the  num- 
bers of  the  problems  in  the  March  test,  while  those  above  the 
line  are  the  numbers  of  the  problems  in  the  June  test. 

The  second  series  of  figures  at  the  top  of  the  diagram  (indicat- 
ing) represents  the  percentage  of  pupils  who  solved  the  problems 
correctly.  You  will  notice  that  75  per  cent  corresponds,  as  it 
should,  to  — 100  on  the  upper  line,  and  that  25  per  cent  corre- 
sponds to  +100.  Other  correspondencies  are  as  indicated  thru- 
out  the  extent  of  the  scale. 
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In  the  March  test  the  "ma])  prol)lem"  which  you  may  read 
as  No.  1  on  the  first  sheet  of  the  material  I  have  siven  you,* 
was  answered  correctly  by  73^  per  cent  of  tlie  ])U])ils  of  tiie  h)\ver 
seventh  grade.  You  will  S(>e  that  it  is  found  Ix^tween  the  figure 
5  and  the  figure  10  of  the  ])er  cents.  By  using  a  conversion 
table,  it  is  found  that  a  ])roblem  answered  correctly  by  IY2 
per  cent  of  a  grouj)  of  pu])ils  would  be  placed  on  the  base  line 
of  the  surface  of  fretpiency  at  +2.13  P  E.;  and  you  will  n()ti(;e 
that  it  lies  here  a  little  to  the  right  of  200  (indicating),  according 
to  the  P.E.  values  of  the  to})  line.  It  will  l)e  interc^sting  to  follow 
tliis  ])i'obleni  as  it  a])pears  in  tiie  other  grade  scales.  It  was 
answered  correctly  in  tiie  u])i)er  seventh  grade  by  12.8  ])er  cumt 
of  the  children.  This  corresponds  to  l.()9  P.E.  You  will  there- 
fore find  this  ])roblem  located  on  the  ui)per  seventii  grade  scale 
about  midway  between  10  per  cent  and  15  per  cent,  and  a  little  to 
the  right  of  160  (indicating  Problem  1).  In  the  lower  eighth 
grade,  problem  1  of  the  March  test  was  solved  correctly  by  24.1 
per  cent  of  the  children,  which  locates  it  at  +1.04  P.E.  In  the 
upper  eighth  grade  it  was  answ^ered  correctly  b}^  41.6  per  cent 
of  the  children,  which  places  it  at  +0.32  P.E. 

Notice  the  regular  increase  in  the  ability  of  the  different  grades 
as  shown  by  their  success  in  solving  this  first  pro])lem  of  the 
March  test.  If  we  join  the  points  at  which  the  ])roblem  falls 
on  each  of  the  scales,  we  shall  almost  have  a  straight  lin(>.  This  is 
true  for  a  number  of  other  ])roblems.  If  it  were  true  for  all  of 
them  we  might  draw  a  straight  line  thru  th(^  four  points  for  each 
problem.  The  slope  of  this  line,  or  the  angle  it  makes  with  one  of 
the  scale  lines,  indicates,  so  far  as  one  problem  can  do  so,  the 
amount  of  increase  in  the  ability  of  children  in  each  successively 
higher  grade.  Notice  that  the  angle  made  by  the  line  joining 
the  points  for  problem  4  of  the  June  test  (indicating)  would  be 
greater  than  that  made  by  the  same  sort  of  a  line  for  Problem  8 
of  the  March  test  (indicating).  This  means  that  the  data  for 
problem  4  indicate  less  improvement  from  grade  to  grade  than  do 
the  data  for  problem  8.  The  greater  the  angle,  the  less  the 
improvement.  If  the  angle  were  90  degrees,  no  improvement 
would  be  showm.  Theoretically  all  the  lines  should  be  straight 
and  they  should  be  parallel — that  is,  they  should  make  the  same 
angle  with  the  scale  lines.  Doubtless  if  the  number  of  children 
were  very  great,   the  straightness   and  parallelism  of  the  lines 


*See  Appendix. 
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would  be  nearly  approximated.  The  slope  of  these  lines  is  an 
interesting  measure  of  the  amount  of  improvement  from  grade 
to  grade.  It  deserves  a  much  fuller  treatment  than  I  can  give  it 
here. 

It  will  be  interesting  to  note  some  of  the  characteristics  of  the 
problems  in  arithmetic  as  to  their  test  value.  Problems  7  and  9 
in  the  IVIarch  test,  to  which  your  attention  is  directed,  as  the 
"pencil"  prolilem  and  the  "factory  products"  problem,  are  what 
may  be  called  median  problems  for  the  lower  seventh  grade. 
The  first  was  solved  correctly  by  50.8  per  cent  of  the  children 
and  the  second  ])y  46.9  per  cent  of  the  children.  Ability  to  solve 
either  of  these  problems,  therefore,  places  a  child,  so  far  as  the 
problem  is  concerned,  at  the  average  ability  of  the  class,  or  better. 
These  two  problems  may  be  used  to  good  advantage  as  test 
problems  for  the  grade.  A  child  who  cannot  solve  them  affords 
evidence  of  being  l)elow  the  average  ability  of  the  grade.  On  page 
2  of  your  material  you  will  find  two  other  problems  which  for  lower 
seventh  grade  children  in  June  proved  to  be  practically  median 
problems.  They  are  the  third,  or  "Texas"  problem,  and  the 
seventh,  or  the  problem  about  the  farmer's  wife.  The  "Texas" 
problem  was  solved  correctly  by  54.3  per  cent,  and  the  problem 
about  the  farmer's  wife  by  51.7  per  cent  of  the  children.  In  the 
same  way  we  may  select  for  other  grades  directly  from  this  scale 
problems  which  correspond  to  typical  grade  ability.  Such  are, 
for  the  upper  seventh  grade,  problems  5,  9,  and  10  of  the  March 
test,  and  8  and  10  of  the  June  test;  for  the  lower  half  of  the  eighth 
grade  problems  4  and  8  of  the  March  test,  and  6,  9,  and  10  of  the 
June  test;  and  for  the  upper  half  of  the  eighth  grade,  problems 
6  and  10  of  the  March  test  and  1  of  the  June  test.  Problems  in- 
dicating other  than  typical  ability  might  also  be  selected.  For 
instance,  problem  4  of  the  March  test — the  problem  about  the 
economy  of  buying  potatoes  by  the  bushel — is  a  problem  the 
solution  of  which  implies  for  children  of  the  lower  seventh  grade 
an  ability  which  just  places  them  in  the  upper  third  of  the  grade. 
In  the  upper  eighth  grade,  however,  its  solution  would  place  the 
child  just  short  of  the  upper  three  quarters  of  his  grade,  or, 
conversely,  a  child  who  failed  to  solve  it  would  give  evidence 
of  belonging  to  the  lower  quarter  of  his  grade.  In  a  similar 
way,  other  proljlems  lend  themselves  well  to  use  for  pur])oses  of 
diagnosis.  Problems  may  likewise  be  selected  of  approximately 
the  same  difficulty.  In  fact,  the  entire  March  and  June  tests 
are  of  about  the  same  difficulty,  altho  this  equality  does  not  show 
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up  in  the  scalo,  largely  because  the  three  months  that  ela])S('(l 
between  the  giving  of  the  tests  makes  the  June  examples  api)ear 
easier  than  the  March  examples. 

The  method  of  placing  the  problems  on  the  general  scale 
is  one  which  I  will  not  enter  into  in  detail  at  present.  If  you  care 
to  have  me  do  so,  I  will  describe  th(>  method  this  afternoon.  It 
will  l)e  sufficient  to  say  at  this  t'unv  that  tlu^  ])lacing  of  the  ])rob- 
lenis  is  made  by  using  all  the  data  from  the  different  grades  and 
so  combining  them  as  to  give  the  best  average  placing  with 
reference  to  the  median  of  the  lower  seventh  grade.  It  is  to  be 
understood  that  zero  means  the  median  ability  of  the  lower 
seventh  grade.  This  will  account  for  the  fact  that  so  few  ])rol)lenis 
are  placed  below  the  zero  point.  I  shall  take  up  the  remaining 
scales  this  afternoon,  and  shall  try  to  give  you  an  opportunity 
to  ask  questions. 


Round  Table:    Principles  of  Scale  Derivation 

with  Special  Applic^ition  to  Arithmetic, 

Geography-,  History,  and  Grammar 


Led  by  B.   R.  BucKiNCiHAM 

As  matters  developed  this  morning,  1  was  not  able  to  give 
you  just  the  talk  I  had  intended  to  give  you.  I  had  planned  to 
take  forty-five  minutes  for  the  presentation  of  my  material.  It 
was  my  intention  to  give  you  an  opportunity  this  afternoon  to 
ask  questions  about  the  presentation  of  the  morning  and  to  dis- 
cuss it.  Having  been  unable  to  complete  my  report  and  having 
been  obliged  to  abbreviate  parts  of  it,  I  shall  first  try  to  take  up 
certain  omitted  topics  and  then  to  present  the  scales  for  geog- 
raphy, history,  and  grammar. 

In  the  first  place,  I  want  to  show  you  how  the  children's 
answers  were  rated.  The  score  sheet  which  I  use  is  being  passed 
around  to  you.*  You  will  recall  that  all  questions  are  rated  as 
either  right  or  wrong,  no  part  credits  being  allowed.  All  that  is 
necessary,  therefore,  for  a  complete  scoring  is  to  indicate  whether 
the  question  is  right  or  ^^rong.  The  pupils  are  identified  by  num- 
ber across  the  upper  part  of  the  squared  surface.  One  sheet  is 
to  be  made  out  for  each  class.  If,  however,  a  class  consists  of 
more  than  one  grade,  a  sheet  is  to  be  made  for  each  grade  com- 
posing the  class.  In  order  to  make  a  study  of  the  difference  due 
to  sex,  I  have  caused  entries  for  l)oys  to  be  made  in  black  and 
those  for  girls  to  be  made  in  red. 

The  directions  to  the  teachers  reciuire  them  to  number  their 
classes,  giving  the  first  boy  the  number  "one"  and  the  remaining 
boys  the  next  consecutive  numbers.  If  a  mixed  class  had  16 
boys  in  it,  the  first  girl  would  be  number  \7,  the  next  18,  and  so 
on.  The  horizontal  totals  of  scores  give  the  question  results, 
and  on  the  right  you  will  notice  two  triple  columns,  one  for  the 
number  of  answers  not  correct,  and  one  for  the  number  correct, 
each  divided  into  boys,  girls,  and  total.  At  the  extreme  left 
are  listed  the  questions  either  by  nund^er  or  by  a  catch  phrase 

♦Figure  I. 
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and  a  number.  For  instance,  in  arithmetic  we  may  call  question 
number  one  of  the  March  test  the  "map  question",  because  it 
is  about  the  scale  on  a  map;  question  number  two  may  be  called 
the  ''milk-man  question",  number  three,  the  ''fruit  question" — - 
anything  to  distinguish  it,  altho,  of  course,  that  isn't  exactly 
necessary.    The  number  will  suffice. 

Question  number  1  may  be  supposed  to  have  been  entered; 
and  on  the  line  running  from  left  to  right,  score  marks  show  the 
number  of  times  it  was  incorrectly  answered,  black  marks  being 
for  boys  who  got  it  wrong,  red  marks  being  for  girls  who  got  it 
wrong.  At  the  right,  under  the  "Not  correct"  caption,  the  num- 
ber of  boys  who  got  it  wrong  will  be  shown,  then  the  number  of 
girls  who  got  it  wrong,  and  the  total  of  the  two.  Let  us  suppose 
that  the  number  of  boys  who  got  it  wrong  was  8,  and  that  there 
were  15  of  them  in  attendance.  Accordingly,  7  must  have  got 
it  right,  and  7  will  be  entered  under  the  caption  "Correct"  and 
the  sub-caption  "Boys".  If  there  were  18  girls  in  the  class 
and  7  got  it  wrong,  that  would  leave  11  to  be  entered  under  the 
sub-caption  "Girls",  and  the  7  and  11  added  would  give  18  as 
the  number  in  the  class  who  got  the  question  right.  The  vertical 
totals  will  give  the  pupils'  scores.  Suppose  pupil  number  1  gets 
questions  3,  7,  and  10  wrong.  Under  the  number  1  (his  number) 
and  opposite  question  numbers  3,  7,  and  10,  score  marks  will 
be  entered.  The  total  at  the  bottom  after  "Total  Not  Correct" 
will  be  3.  The  "Total  Correct"  will  be  10  less  3,  or  7,  which  is  the 
pupil's  score. 

That  is  the  scheme  of  this  double  entry  score  sheet,  and  nothing 
that  I  know  of  gives  such  richness  of  detail  as  does  this  kind  of 
a  score  sheet.  You  will  find,  as  I  go  a  little  further  and  tell  you 
about  how  the  scales  are  derived,  that  it  is  precisely  this  richness 
of  detail  which  we  need  and  which  customarily  we  do  not  get. 

Besides  the  uses  illustrated  in  this  report  there  are  many  others 
to  which  such  a  score  sheet  may  be  put.  Not  only  does  it  give  pupil 
scores  and  question  scores,  but  it  permits  either  of  these  scores 
to  be  distributed  by  cities.  States,  schools,  grades,  or  classes. 
The  effect  of  the  date  of  giving  the  test— whether  early  or  late  in 
the  term — the  effect  of  the  time  of  day  and  of  the  size  of  class  may 
be  studied.  Sex  differences  both  in  gross  and  for  different  types 
of  questions  may  be  shown;  and  all  the  matters  which  I  have  just 
referred  to  may  be  related  to  the  ages  of  the  children.  By  using 
other  kinds  of  marks  besides  score  marks,  types  of  errors  may  be 
studied.     Thus,  in  spelling,  I  have  used  a  cross  to  indicate  illegi- 
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liility,  a  circle  to  show  that  th(>  word  was  omitted,  an  "a"  to 
indicate  an  absurd  form  of  spelling',  and  an  "s"  to  show  a  sub- 
stitution. I  shoukl  stronf;;ly  advise  all  teachers  to  rate  their 
ordinary  test  papers  by  usins  some  such  double  entry  score  sheet 
as  I  am  showing  you.  It  serves  equally  well  when  a  certain  numl)er 
of  credits  is  assigned  to  each  (luestion;  and  the  knowledge  to 
be  ol)tained  from  such  an  analysis  of  material  will  become  more 
and  more  valuable  as  the  years  go  by.  I  said  something  this  morn- 
ing about  the  waste  involved  in  failing  to  keep  the  results  of 
tests  after  their  immediate  ])ur])()se  has  been  served.  This  is  the 
form  in  which  I  should  file  the  results,  attaching  a  co]iy  of  the 
questions  to  the  scorc^  she(>t.  For  pur])oses  of  identihcation,  I 
should  have  each  pu]Ml  ke(>p  the  same  number  as  long  as  he  was 
in  my  class,  and  should  file  against  the  set  of  score  sheets  a  list 
of  the  pupils'  names  and  numbers.  According  to  a  teacher's  in- 
terest, additional  data  might  also  be  filed  with  a  score  sheet, 
such  as  the  amount,  character,  and  recency  of  the  instruction  given 
the  children  in  various  ])liases  of  the  test,  the  condition  of  the 
room  in  which  the  test  was  taken  (temperatures  humidity,  ven- 
tilation, illumination),  wluit  kind  of  work  the  children  had  pre- 
viously been  doing  during  the  (l:i>'  on  which  they  took  the  test, 
the  method  of  conducting  the  test  (dir(>ctions  given,  helps,  if  any, 
amount  of  time,  etc.),  who  conducted  it,  and  for  what  purpose. 

This  morning  I  showed  you  a  scale  for  some  problems  in 
arithmetic.  I  shall  now  take  up  the  subject  of  ge()gra])hy.  I 
have  already  told  you  something  aljout  the  selection  of  the 
questions,  and  they  form  part  of  the  material  which  you  have 
in  your  hands  (see  Appendix).  There  were  20  questions  in  the 
March  test  and  the  same  number  in  the  June  test.  The  scale, 
therefore,  for  geography,  shows  40  questions.  The  appropriate- 
ness of  the  test  material  from  the  point  of  view  of  the  difficulty 
of  the  questions  may  be  judged  by  the  extent  to  which  the  surface 
of  frequency  for  each  of  the  grades  corresponds  to  the  so-called 
normal  surface.*  You  will  gather  from  these  diagrams  that 
improvement  in  geography  from  grade  to  grade  is  not  great.  Such 
is   indeed   the   case.      Since   the   median   for   the   lower   seventh 


*At  this  point  diagrams  were  shown  in  which  was  given,  for  eacli  grade,  the  ])er- 
rentage  distribiition  of  pupils  answering  correctly  no  questions,  one  question,  two 
questions,  etc.  These  diagrams  are  not  reproduced  here.  Attention  was  called  to 
the  almost  ideal  character  of  these  surfaces  of  frequency.  The  medians  were  as  fol- 
lows: For  the  lower  seventh  grade.  10.75  questions;  for  the  upper  seventh  grade, 
11.12  questions;  for  the  lower  eighth  grade,  12.17;  and  for  the  upper  eighth  grade. 
1.^.70. 
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grade  is  10.75,  and  that  for  the  uj)per  eighth  grade  is  18. 70,  it 
appears  that  the  ackhnl  year  and  a  half  of  school  lif(!  have  enabled 
the  children  of  the  U])])er  eighth  grade  to  answer,  on  the  average, 
just  3  more  questions  correctly  out  of  these  20. 

The  diagram  which  I  show  you  here  (Figure  II)  is  the  scale 
for  the  difficulty  of  40  (luestions  in  geography.  I  take  it  that  you 
are  more  interested  in  the  scaling  of  the  content  subjects,  or 
something  from  the  content  subjects,  than  you  are  in  anything 
else  that  1  could  offer  to  you,  and  I  am  (juite  sure  that  nothing 
that  I  could  give  you  would  be  newer  or  more  original  material. 
I  am  sorry  that  this  picture  does  not  show  u])  better  on  th(; 
screen.  In  respect  to  the  amount  of  material  (40  questions), 
it  is  the  best  scale  I  have  to  offer  this  afternoon.  The  easiest 
question  is  located  here  on  the  general  scale  (indicating) ;  it  is 
question  nund)er  1  of  the  June  test.  The  question  is,  ''In  what 
country  is  London?"  In  the  lower  seventh  grade  the  same  (pies- 
tion  also  appears  as  the  easiest;  98.2  per  cent  of  the  children  an- 
swered it  correctly.  This  places  it  on  the  P.E.  scale  at  —.311. 
This  question  number  1  of  the  June  test,  you  can  see,  is  a  little 
to  the  right  of  320,  or  towards  zero.  You  will  also  note  that 
this  98  per  cent  figure  (indicating  on  lower  series)  is  also  r(>garded 
in  the  placing  of  the  question,  because,  as  I  said  a  moment  ago, 
98.2  per  cent  of  the  children  got  this  question  right. 

Notice  how  this  question  runs.  It  is,  as  I  have  said,  the  easiest 
in  the  lower  seventh;  again,  it  is  the  easiest  in  the  upper  seventh; 
again,  in  the  lower  eighth,  and  consistently,  in  the  upper  eighth. 
Consequently,  it  becomes  the  easiest  question  when  all  grades 
are  considered,  as  the  general  scale  shows. 

You  understand  that  these  figures  along  here,  the  upper 
figures  on  each  scale,  represent  the  June  questions;  the  lower 
figures  represent  the  March  questions.  The  hardest  question  was 
number  19  of  the  March  test.  The  question  reads,  "South  of  the 
equator,  in  what  direction  do  the  trade  winds  blow?"  This 
nineteenth  question  of  the  March  test  is  located,  for  the  lower 
seventh  grade,  right  here  where  I  point,  having  been  answered 
by  about  4  per  cent  of  the  children,  which  gives  it  a  position  at 
+254,  according  to  the  P.E.  values.  You  can  see  that  it  is  also 
the  farthest  question  to  the  right  (and  hence  the  hardest)  for  the 
upper  seventh;  it  is  likewise  the  hardest  for  the  lower  eighth; 
and  again,  for  the  upper  eighth,  consequently,  of  course,  for  all 
combined. 
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You  have  no  doubt  noticed  that  while  the  first  June 
(luestion  is  always  the  easiest  question,  and  Avhilc  the  nineteenth 
March  question  is  always  the  hardest,  there  is  not  the  same  per- 
manence of  station  for  the  intermediate  questions.  As  I  pointed 
out  in  considering  the  arithmetic  scale,  an  ideal  arrangement 
of  the  questions  would  be  such  that  parallel  lines  might  be  drawn 
connecting  each  series  of  points  for  the  same  question.  Now, 
altho  this  ideal  arrangement  is  apparently  not  at  all  closely 
approximated,  there  is,  nevertheless,  a  substantial  permanence 
of  arrangement,  in  the  sense  that  the  easiest  question  in  one  grade 
tends  to  be  the  easiest  in  any  other  grade,  the  next  to  the  easiest 
in  one  grade  tends  to  be  the  next  to  the  easiest  in  any  other 
grade,  and  so  on.  This  tendency  is  not  easily  seen  in  the  diagram 
unless  you  scrutinize  it  carefully.  It  is  so  strongly  present,  how- 
ever, that  the  correlation  coefficient  between  the  ratings  of  the 
March  questions  for  the  different  grades,  as  ol)tained  by  the 
"Foot  Rule"  method,  is  in  no  case  less  than  +0.90,  and  in  2  of  the 
6  possible  pairings  it  rises  to  +0.99.  This  means  that  the  test 
value  of  a  question  in  the  lower  seventh  grade  is  essentially  the 
same  in  each  of  the  other  grades.  The  hardest  question  remains 
the  hardest  question,  the  easiest  question  remains  the  easiest, 
and  the  questions  which  rank  between  tend  to  hold  their  positions 
for  each  grade  in  the  order  of  difficulty.  So  strong  is  this  tendency 
that  for  the  March  questions  there  is  an  exact  correspondence 
thruout  the  4  grades  in  5  of  the  20  instances.  Between  consecutive 
grades  there  is  an  exact  correspondence  in  more  than  half  the 
cases,  and  in  no  case  is  the  rank-difference  of  a  question  more 
than  6.  Question  num])er  6,  located  here  at  -59  P.E.  for  the 
lower  seventh  grade  (indicating),  is  the  sixth  in  order  from  the 
left;  that  is  to  say,  it  is  sixth  in  point  of  difficulty  for  that  grade. 
The  question  is:  "Name  a  leading  State  of  the  United  States  in 
the  production  of  cotton."  In  the  upper  seventh  grade  it  is 
likewise  sixth  in  order  of  difficulty.  In  the  lower  eighth  grade, 
however,  you  will  find  by  counting  along  the  scale  that  it  is 
eleventh  in  difficulty,  while  in  the  upper  eighth  grade  it  is  twelfth. 
Why  it  should  be  more  difficult,  grade  considered,  for  an  eighth 
grade  child  to  name  a  cotton  State  than  for  a  seventh  grade 
child,  I  do  not  know. 

It  would  be  interesting  to  go  over  these  questions  in  detail, 
comparing  their  importance  and  test  value  for  each  of  the  grades. 
I  am  afraid  if  I  tried  to  do  this,  I  should  only  succeed  in  being 
confusing  and  I  am  sure  I  should  consume  time.     Median  ques- 
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tions,  however,  are  so  sij2;nificant,  and  may  so  easily  be  selected 
from  the  scale  that  I  shall  call  your  attention  to  some  of  them. 
The  reason  why  median  questions  are  interesting  is  that  they 
reveal  something  concerning  typical  grade  ability.  In  this  sense, 
question  5  of  the  March  test,  located  here,  may  be  selected  for 
the  lower  seventh  grade.  A  child  who  is  able  to  answer  it  shows, 
so  far  as  one  question  can  do  so,  an  ability  which  is  at  least  that 
of  the  midmost  child  of  the  lower  seventh  grade.  The  fifth 
question  is,  "Name  a  railway  system  connecting  New  York  and 
Chicago."  Fifty  per  cent  of  the  lower  seventh  grade  children  in 
New  York  City  can  answer  that  question. 

It  will  readily  occur  to  you  that  sonn^  of  these  questions  have 
a  local  significance;  that  perhaps  50  per  cent  of  the  children  in 
Wisconsin,  Montana,  or  Utah  wouldn't  be  able  to  do  that.  The 
great  majority  of  questions  in  the  geography  scale,  however, 
are  quite  indejiendent  of  such  local  conditions.  As  a  matter 
of  fact,  when  we  have  the  equipment  of  scales  that  we  desire, 
local  g(>ogru])hy  will  have  its  own  local  scale. 

Another  lower  seventh  median  cpiestion  which  you  may  note 
on  your  list,  if  you  care  to,  is  numl)er  8  of  the  June  t(^st:  "What 
river  forms  a  i)orti()n  of  the  boundary  between  l^urope  and  Asia?" 
This  is  a  question,  for  instance,  which  is  quite  independent,  I 
should  say,  of  any  locality  in  the  United  Stat(>s.  Number  9  of  the 
June  test  is  likewise  a  median  ([Uestion,  "W'luit  circles  bound 
the  torrid  zon(>?"  Also  nuinl)cr  \'A,  "Name  an  iini)ortant  city 
on  the  Danu])e  River";  number  14,  "What  State  is  south  of 
Utah?"  and  number  Ki,  "Name  an  important  city  on  the  Clyde 
River."  All  these  questions  appear  to  require  at  least  typical 
lower  seventh  grade  ability  to  answer  them;  and  they  appear 
also  to  be  as  likely  to  do  so  in  one  school  as  another  so  far  as 
its  location  is  concerned. 

For  the  upper  seventh  grade,  from  the  March  test,  the  ninth 
question  is  one  which  only  half  the  pupils  can  answer.  The 
thirteenth  question  is  also  not  far  from  the  50  per  cent  mark,  as 
you  can  see.  About  45  per  cent  of  the  upper  seventh  grade  chil- 
dren can  answer  the  question  "From  what  is  latitude  reckoned?" 
For  the  upper  seventh  grade,  from  the  June  test,  the  tenth  and 
thirteenth  are  likewise  median  questions.  For  the  lower  eighth 
grade,  the  fifteenth  question  from  the  March  test  is  a  median 
question.  For  the  upper  eighth,  such  questions  are  the  eleventh, 
seventeenth,  and  eighteenth  from  the  March  test;  and  the  eleventh 
from  the  June  test. 
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It  is  interesting  to  note  that  some  of  the  questions  in  geography 
are  not  answered  correctly  by  as  many  children  in  higher  grades 
as  in  lower  grades.  This  is,  of  course,  not  generally  true,  but  is 
sometimes  true  and  ought  to  be  pointed  out.  If  more  participants 
took  part  in  the  test  and  if  a  larger  number  of  cities  were  rep- 
resented, some  of  these  irregularities  would  doubtless  disappear. 
The  amount  and  recency  of  instruction  has  something  to  do  with 
the  fact  that  the  figures  for  these  questions  do  not  progress  regu- 
larly from  one  grade  to  another.  Probably  the  best  plan  would 
be  for  us  to  cooperate  in  the  further  testing  of  these  questions, 
and  if,  after  results  have  been  obtained  from  a  considerable 
number  of  participants,  some  of  these  inversions  do  not  disappear, 
to  reject  these  questions  from  further  consideration.  I  am  sure 
that  even  with  geography,  where  this  feature  appears  to  be  most 
prominent,  it  would  not  be  difficult  to  scale  100  to  150  entirely 
satisfactory  questions  out  of  the  180  which  I  have  on  hand. 

It  will  readily  occur  to  you  that  in  all  these  subjects  and 
perhaps  particularly  in  geography,  the  value  of  the  scale  will 
l)e  diminished  in  proportion  to  the  numl^er  of  times  it  is  used. 
It  represents  present  conditions  for  schools  in  New  York  which 
are  thought  to  be  fairly  typical.  The  best  remedy  for  overcoming 
the  difficulty  due  to  familiarity  with  the  scale  is  to  enrich  it 
with  a  great  number  of  questions,  to  such  an  extent  that  familiarity 
with  the  scale  will  come  to  mean  familiarity  with  the  subject 
itself.  When  this  condition  is  brought  about,  the  usefulness  of 
the  scale  will  have  been  abundantly  demonstrated.  It  will  not 
cease  to  have  value  because  children  will  not  learn  all  the  questions 
(we  need  give  ourselves  no  uneasiness  about  that),  l)ut  it  will 
need  readjustment  to  changed  conditions. 

It  is  a  curious  thing  how  little  effect  instruction  has,  sometimes, 
on  matters  of  this  kind.  Did  you  ever  give  the  Binet  test  to  child- 
ren who  had  been  coached  for  it?  If  yo.u  have,  you  know  how  little 
good  it  did  them.  Tlie  effect  of  the  most  careful  instruction 
is  by  no  means  to  secure  a  perfect  response.  If  such  were  not 
the  case,  Avords  like  "believe"  and  "receive"  would  not  be  mis- 
spelled by  50  per  cent  of  fifth  grade  children,  nor  the  word  "sep- 
arate" by  50  per  cent  of  seventh  grade  children.  Everyl^ody 
knows  that  the  word  "separate"  is  a  catch  word,  a  hard  word, 
and  every  teacher  teaches  it  as  such,  and  yet  children  continue  to 
miss  it,  until,  as  it  seems,  they  have  reached  a  certain  maturity 
or  have  a  sufficient  need  for  it  to  ensure  its  accurate  use. 

I  have  a  great  more  material  in  hand  for  a  geography  scale 
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than  is  shown  here.  I  have  returns  from  180  questions  of  which 
these  40  are  a  sample.  If  any  of  you  care  to  see  some  of  the 
rest  of  the  questions,  I  shall  be  very  glad  to  show  them  to  you, 
and  also  to  tell  you  how  hard  they  ar(>.  The  material,  however, 
is  so  voluminous  and  it  has  so  lately  reached  my  hand  in  usable 
form  that  it  will  probably  be  several  months  before  I  shall  be 
able  to  present  it.  Even  then,  the  number  of  jiarticipauts  for  many 
of  the  questions  will  be  too  few  to  be  ideal. 

For  questions  which  I  am  showing  you  today,  however,  the 
number  of  ])articipants  seemed  to  me  to  be  sufficient  for  practical 
purposes.  There  were  tested  in  each  of  the  subjects  about  3,000 
in  the  lower  seventh  grade,  2,700  in  the  upper  seventh,  2,300  in 
the  lower  eighth,  and  2,000  in  the  upper  eighth;  a  total  of  about 
10,000  children.  I  say  "about"  because  the  numlier  varied  a 
little  as  between  subjects. 

The  general  scale  for  geography  is  an  attempt  to  answer, 
without  reference  to  any  particular  grade,  this  question:  What 
is  the  difficulty  of  each  question?  deserve  that  the  percentages 
shown  in  the  ui)])er  line  here  have  no  reference  whatev(>r  to  the 
general  scale,  but  only  to  the  four  grade  scales.  The  P.E.  values 
are  the  only  ones  that  govern  in  the  bottom  scale.  It  will  be 
interesting  to  n^te  some  of  the  uses  which  may  be  made  of  the 
general  scale  considering  the  June  questions  only.  Pupils  may 
be  given  these  questions  arranged  in  the  order  of  their  difficulty 
from  1  to  19,  as  follows:  1,  2,  3,  4,  6,  5,  7,  9,  8,  10,  13, 
15,  16,  12,  11,  14,  17,  20,  18,  19.  Pupils  may  be  given  the  questions 
in  that  order  and  directed  to  answer  tliem  in  that  order.  By 
being  able  to  answer  number  1  of  the  June  test,  "In  what  country 
is  London?"  a  loAver  seventh  grade  child  merely  shows  that  he 
is  not  the  poorest  or  the  next  to  the  poorest  child  among  100 
pupils  of  his  grade,  taken  at  random.  This  is  true  from  the  fact 
that  98  per  cent  of  the  lower  seventh  grade  children  can  answer 
this  question  correctly.  Therefore,  if  he  answers  it,  he  only  shows 
that  he  is  among  that  98.  He  is  not  the  ninety-ninth  or  one- 
hundredth;  that  is,  he  is  not  the  poorest  or  the  next  to  the  i)oorest. 

By  answering  the  second  question,  "What  is  the  capital  of  the 
United  States?"  the  same  pupil  would  show  evidence,  as  far  as 
this  question  can  show  it,  that  he  is  not  among  the  5  poorest 
pupils  among  100  selected  at  random  from  the  lower  seventh 
grade. 

Similar  statements  could  be  made  concerning  the^ succeeding 
questions  along  the  scale.    By  answering  question  7,  "Name  the 
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zones  into  which  the  earth  is  divided",  he  would  show  that  he 
belonged  among  the  upper  three-quarters  of  the  seventh  grade, 
second  half.  By  being  able  to  answer  the  thirteenth  (luestion, 
he  would  show  an  ability  which  is  practically  typical  of  all  the 
grades  except  the  upper  eighth.  For  that  grade,  he  would  barely 
escape  being  in  the  lower  30  per  cent,  because  th(>  thirteenth 
fiuestion  is  right  here  (indicating)  for  the  upper  eighth  grade, 
that  is,  it  is  just  about  at  70  per  cent.  This  means  that  70  per  cent 
of  the  children  can  answer  it,  and  by  answering  it  the  child  just 
escapes  being  in  the  lower  30  per  cent. 

In  any  use  of  the  general  scales,  whether  in  one  subject  or 
another,  we  must  provide  for  handling  the  problem  of  children 
who  fail  on  easy  questions  and  answer  hard  ones,  in  other  words, 
for  the  children  who  do  not  answer  all  the  questions  of  our  general 
scale  up  to  a  certain  point,  and  then  fail  altogether.  We  know 
in  the  Binet  test,  for  instance,  that  children  will  answer  questions 
up  to  a  certain  point,  or  do  the  things  required  of  them  up  to  a 
certain  point,  and  then  they  will  make  one  or  two  failures,  and 
then  a  few  successes,  interspersed  with  failures  and  successes, 
for  a  little  way  beyond. 

The  present  scoring  method  takes  account  of  this.  Al)out  the 
same  plan  would  do  here.  Briefly,  I  would  say  this:  I  would  give 
a  child  credit  on  the  basis  of  what  the  P.E.  values  are  for  his 
continuous  performance  up  to  the  point  where  he  quits.  Suppose 
he  answers  his  first,  second,  and  third  of  the  geography  June 
test;  that  brings  him  to  —150.  Take  that  as  a  point  of  departure 
and  add  his  success  from  that  out,  and  the  result  will  place  that 
child,  as,  say,  a  typical  7-A  child,  or  a  typical  7-B  child,  or  among 
the  first  25  per  cent  of  the  seventh  grade,  or  whatever  plan  you 
adopt  for  purposes  of  classification.  It  is  a  rather  simple  matter 
to  handle.  The  point  is  that  the  P.E.  values  of  the  upper  part 
of  the  scale  give  an  absolute  rating  which  you  can  use.  The  per 
cents  do  not. 

If  you  should  wish  to  use  questions  in  geography  which  differ 
in  difficulty  by  about  equal  amounts,  selections  from  this  general 
scale  may  be  made  by  choosing  a  series  of  points  such  that  the 
distances  between  those  that  are  consecutive  are  about  the  same. 
Such  a  series  of  questions,  from  the  June  test,  would  be:  No.  1, 
at  -305,  "In  what  country  is  London?"  No.  2,  at  -222,  "What 
is  the  capital  of  the  United  States?"  No.  3,  at  -138,  "Name  the 
six  continents";  No.  7,  at  —68,  "Name  the  zones  into  which  the 
earth  is  divided";  No.  10,  at  +9,  "Name  a  leading^State  of  the 
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United  States  in  the  production  of  wheat";  No.  11,  at  +79,  "For 
what  industry  is  Pittsburg  noted?"  and  No.  18  at  +155  "Name 
three  pubHc  buikhngs  in  Washington,  D.C."  The  steps  between 
consecutive  questions  in  this  series  average  0.77  P.E.,  and  none 
of  the  steps  are  larger  or  smaUer  than  the  average  by  any  con- 
siderable amount. 

In  history,  12  questions  were  given  in  March  and  12  questions 
in  June.  A  diagram  showing  the  distribution  of  individual  ratings 
\\()ul(l  indicate  an  approximately  normal  surface  of  frequency. 
As  in  the  case  of  geography  and  arithmetic,  the  test  material 
appears  to  hav(^  ])een  adequate  for  the  purpose,  since  it  was  not 
so  difficult  that  the  less  capable  children  could  not  accomplish 
something,  nor  so  easy  that,  the  brightest  childrcni  were  able  to 
do  all  of  it.  The  median  for  the  lower  seventh  grade  in  the  March 
test  is  about  43^  questions  correct  per  pui)il;  that  for  the  upper 
seventh  grade  is  about  43^2  questions;  for  the  lower  eighth  grade 
it  is  63^  questions,  and  for  the  upper  eighth  grade  about  73^ 
questions.  All  these  medians  arc  in  terms  of  (piestions  correct 
out  of  a  possible  12. 

This  (Figure  III)  is  the  scale  for  history.  The  plan  for  placing 
the  questions  is  the  same  as  it  was  for  arithmetic  and  geography. 
The  total  extent  of  the  scale  is  from  question  1  of  the  March  test, 
"In  what  war  was  the  battle  of  Gettysburg  fought?"  which  was 
answered  corrcclly  by  more  than  90  per  cent  of  the  ciiildren  in 
each  of  the  grades,  to  question  7  of  the  March  test,  "Under  whose 
administration  was  the  Civil  Service  Commission  established?" 
and  question  12  of  the  March  test,  "To  what  political  party  in 
England  did  most  of  the  settlers  of  Virginia  belong?"  Each  of 
these  two  questions  was  answered  correctly,  on  the  average,  for 
all  of  the  grades,  by  about  14  per  cent  of  the  children. 

Median  questions  in  history  for  the  lower  seventh  grade  are, 
from  the  March  test,  No.  2,  "At  about  what  time  was  the  first 
message  sent  by  telegraph?"  No.  5,  "State  one  important  general 
plan  carried  out  by  the  navy  of  the  North  in  the  Civil  War"; 
and  No.  10,  "In  general,  what  was  the  attitude  of  England  toward 
the  South  during  the  Civil  War?"  From  the  June  test,  question 
4,  "In  what  year  did  government  under  the  Constitution  of  the 
United  States  begin?"  and  question  11,  "Give  the  substance  of 
one  amendment  to  the  Constitution  made  as  a  result  of  the  Civil 
War",  are  likewise  median  cjuestions  for  the  lower  seventh  grade. 

Without  reading  the  questions,  I  may  indicate  as  median 
questions  for  the  upper  seventh  grade,   No.   2  from  the   March 
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test  and  No.  4  from  the  June  test;  for  the  lower  eighth  grade, 
Nos.  3,  5,  8,  and  11  from  the  March  test,  and  No.  5  from  the 
June  test.  For  the  upper  eighth  grade  No.  7  from  the  June  test 
is  a  median  question  to  a  hair,  and  No.  11  from  the  March  test 
is  approximately  a  median  question. 

In  grammar,  two  tests  were  given,  one  to  the  lower  seventh 
grade,  consisting  of  10  questions,  and  one  to  the  grades  above 
the  lower  seventh,  consisting  of  14  questions.  The  results  from 
these  tests  were  not  as  satisfactory,  so  far  as  yielding  a  type  of 
distribution  approximating  the  normal  surface  of  frequency  is 
concerned.  The  test  was  too  difficult,  altho  the  distribution  is 
quite  as  good  as  that  of  many  tests  from  which  important  con- 
clusions have  been  drawn  in  the  field  of  experimental  education. 

The  scale  for  grammar  (Figure  IV)  shows  the  placing  of  38 
different  questions.  Fourteen  were  given  both  in  March  and  June 
to  the  upper  seventh,  lower  eighth,  and  upper  eighth  grades; 
10  questions  were  given,  both  in  March  and  June,  to  the  lower 
seventh  grade;  but  in  each  case  5  of  these  were  the  same  as 
those  given  on  the  test  of  the  upper  grades.  This  leaves  but  five 
questions  on  each  of  the  lower  seventh  grade  lists  in  addition  to 
those  used  in  the  upper  grades.  The  scale  for  grammar  shows 
the  lower  seventh  grade  independently  of  the  others.  You  have 
in  your  hands  the  March  and  June  lists  of  questions  for  the  lower 
seventh  grade,  and  you  also  have  different  lists  of  questions  for 
the  remaining  grades,  one  for  March  and  one  for  June.  The 
numbers  on  these  scales  refer  to  those  questions. 

The  hardest  question  for  the  lower  seventh  grade  was  the 
seventh  from  the  March  test,  located  here  (indicating  on  scale). 
The  question  is,  "Give  an  example  in  a  sentence  of  the  positive 
degree  of  the  adverb  'better'  and  underline  it."  This  question 
was  answered  by  only  6  per  cent  of  the  lower  seventh  grade 
children.  The  easiest  question  for  this  grade  was  number  4 
from  the  June  test;  and  yet  only  62  per  cent  of  the  children 
were  able  to  answer  it  correctly.  The  question  was  "Underline 
the  subject  word  once  and  the  verb  twice  in  the  following  sentence, 
'The  cold  November  rain  is  falling.'  " 

The  nearest  approach  to  median  questions  for  this  grade  is 
found  in  questions  2  and  3  from  the  March  test.  You  can  mark 
them  as  median  questions  if  you  care  to.  In  the  grammar  test 
for  grades  from  the  upper  seventh  to  the  upper  eighth,  the  scales 
show  that  most  of  the  questions  were  found  to  be  too  difficult. 
In  the  upper  seventh,  out  of  a  total  of  28  questions,  there  were 
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25  questions,  each  one  of  whic^li  was  answered  correctly  by  less  than 
one-half  of  the  children.  For  that  grad(\  the  hardest  question 
(only  2  per  cent  correct)  was  No.  10  from  the  June  test.  The 
question  was,  "Change  the  following  complex  sentence  into  a 
simple  sentence,  without  altering  its  meaning:  'We  saw  that  it 
was  wise  to  give  in.'  "  The  easiest  question  (61  i)er  cent  correct) 
was  number  13  of  the  June  test:  "dive  an  example  in  a  sentence 
of  an  adverb  of  time,  and  underline  it."  In  the  lower  eigiith  grade 
every  question  in  the  March  test  was  answered  correctly  by  fewer 
than  50  per  cent  of  the  children ;  and  of  the  14  questions  in  the 
June  test,  9  were  answered  by  fewer  than  50  per  cent  of  the 
children. 

The  test  in  grammar  did  not  prov(>  to  be  altogether  satis- 
factory. A  great  many  principals  are  (loul)ting  the  wisdom 
of  the  teaching  of  formal  grammar  in  t\\v  grades,  and  alt  ho  it  is 
in  the  course  of  study  in  most  cities,  1  fancy  it  is  not  being  stressed 
as  nuich  as  it  used  to  be,  or  as  is  necessary  for  making  a  good 
showing  on  a  test.  We  all  know  that  the  question  of  teaching 
formal  grammar  in  the  elementary  school  is  being  debated,  and 
that  those  who  are  opposed  to  its  place  in  the  curriculum 
appear  to  be  making  out  a  good  case.  I  doubt  if  I  should  have 
included  a  test  in  grammar  as  a  test  in  om^  of  the  iundaniental 
subjects,  if  I  had  not  been  particularly  reciucsted  to  do  so.  I 
should  like  to  try  these  questions  in  the  high  school. 

In  the  material  which  you  have  in  your  hands  I  have  included 
a  tabular  showing  for  each  question  of  all  the  subjects  and  the 
percentage  of  pupils  who  answered  it  correctly.  In  this  tabulation 
all  grades  are  combined.  In  the  absence  of  further  information 
about  these  questions,  this  tabulation  may  be  taken  as  indicating 
a  standard  based  on  actual  returns.  If  you  give  any  of  these  ques- 
tions to  pupils  in  your  own  schools,  it  will,  no  doubt,  1)e  inter(>sting 
for  you  to  compare  your  results  with  this  tabulation. 

Before  concluding  this  report  I  should  like  to  give  you  a 
brief  statement  of  the  manner  in  which  the  general  scales  for  each 
of  the  subjects  were  constructed.  You  will  remember  that  in  each 
of  the  diagrams  giving  the  scales  there  was  a  line  at  the  bottom 
on  which  was  shown  the  arrangement  of  ciuestions,  irrespective 
of  the  grades.  The  method  of  constructing  the  general  scale 
is  rather  straightforward,  and  anyone  can  employ  the  method 
without  much  technical  knowledge. 

In  the  first  place,  a  dou])le  entry  score  sheet,  such  as  I  showed 
you   at  the  beginning  of   my   talk  this   afternoon,   is   necessary. 
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because  we  can  get  from  it  l)oth  the  question  results  and  the 
personal  or  individual  results.  For  the  grade  scales,  all  you 
need  are  the  question  results.  When  you  know  the  number  of 
children  in  each  of  the  classes  concerned  w^ho  answered  a  given 
question  correctly,  all  you  have  to  do  is  to  add  these  together 
and  find  the  total  number  of  participants,  getting  the  per  cent 
that  the  number  of  correct  answers  is  of  the  total  participants. 
This  per  cent  value  is  to  be  transmuted  into  a  value  in  which  the 
variability  of  a  normal  surface  of  frequency  is  the  unit.  For  this 
purpose  we  may  use  as  our  unit  the  probable  error  or  the  average 
deviation  or  the  standard  deviation.  I  have  used  the  probable 
error  because  it  is  easy  to  define.  It  is  an  amount  of  al)iHty 
above  or  below  the  median  such  as  to  include  half  the  total 
number  of  ratings.  In  a  normal  distribution,  if  we  arrange  all 
the  participants  in  the  order  of  their  ratings,  and  if  we  count, 
from  the  beginning,  one-quarter  of  the  way  and  three-quarters 
of  the  way,  half  the  difference  between  the  measures  which  we 
reach  is  the  probable  error. 

The  next  thing  to  do  is  then  to  transmute  the  per  cents  into 
units  of  the  probable  error.  For  that  you  will  simply  need  a 
table;  I  have  published  one  in  my  study  of  spelling,  and  Dr. 
Thorndike  has  an  abbreviated  one  in  his  "Mental  and  Social 
Measurements".  As  soon  as  you  have  these  P.E.  values, 
you  mark  them  off  on  a  horizontal  line.  In  placing  a  question 
on  a  general  scale,  the  essential  things  to  know  are:  first,  the 
placings  of  the  questions  on  the  grade  scales,  and,  second,  the  in- 
tervals between  the  medians  of  each  of  the  grades.  For 
the  general  scale,  any  convenient  point  of  reference  may  be  taken 
and  arbitrarily  called  zero.  I  have  always  used  the  median 
of  the  lowest  grade  in  the  series  of  grades  to  which  the  test  was 
given.  When  such  is  the  case,  add  to  the  value  of  a  ques- 
tion for  each  of  the  higher  grades  the  interval  at  which  each 
grade  median  stands  above  the  median  of  the  lowest  grade.  To 
illustrate:  The  first  question  in  arithmetic  in  the  March  test 
was  answered  by  children  in  such  a  way  as  to  be  placed  at 
+  2.13  P.E.  for  the  lower  seventh  grade,  at  +1.69  P.E.  for 
the  upper  seventh  grade,  at  +1.04  P.E.  in  the  lower  eighth 
grade,  and  at  +0.32  P.E.  in  the  upper  eighth  grade.  To  obtain 
the  placing  on  the  general  scale,  it  will  be  necessary  to  add  to 
+  1.69  P.E.  the  distance  between  the  medians  of  the  upper  and 
lower  seventh  grades.  This  difference  amountcnl  to  0.66  P.E.  which, 
when  added  to  1.69  P.E.,  gives  2.35  P.E.  as  tiic  distancM"  above 
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the  lower  seventh  grade  median,  according  to  the  record  made  in 
the  upper  seventh  grade.  The  placing  of  this  question  for  the 
lower  eighth  grade  was,  as  I  have  said,  +  1.04  P.E.,  with  reference 
to  the  median  of  that  grade.  To  refer  this  placing  back  to  the 
median  of  the  lower  seventh  grade,  it  will  be  necessary  to  add  to 
1.04  P.E.  the  interval  between  the  median  of  the  lower  seventh 
and  the  median  of  the  lower  eighth  grade.  This  I  found  to  be 
1.20  P.E.  Adding  this  to  1.04  P.E.  gives  2.24  P.E.  as  the  placing 
of  the  question  with  reference  to  the  lower  seventh  grade  median, 
and  according  to  the  lower  eighth  grade  record.  The  interval 
between  the  upper  eighth  grade  median  and  the  lower  seventh 
grade  median  is  found  to  be  2.06  P.E.  When  this  amount  is  added 
to  0.32  P.E.,  the  result  is  2.38  P.E.,  as  the  placing  of  the  question 
with  reference  to  the  lower  seventh  grade  median,  and  according 
to  the  upper  eighth  grade  record.  If  each  grade  above  the  lowest 
did  as  much  better  with  the  problem  as  the  median  intervals 
would  lead  us  to  c^xpect,  the  placing  of  the  probkun  on  the  recortl 
of  each  grade  higher  than  the  first  would  coincide  with  the  placing 
on  the  lowest  grade  record.  This  condition  is  hardly  to  be  ex- 
pected, and,  as  a  matter  of  fact,  the  best  placing  for  the  general 
scale  is  taken  to  be  the  average  of  the  four  placings  from  the  four 
different  grade  records. 

I  have  said  that  it  is  necessary  to  know  the  median  intervals 
between  the  lower  seventh  grade  and  each  of  the  grades  above  it, 
and  I  have  given  these  for  arithmetic  as  0.66  P.E.,  2.20  P.E., 
and  2.06  P.E.  The  determining  of  these  distances  is  based  upon 
the  amount  of  overlapping  of  each  grade  record  beyond  the  median 
of  the  next  higher  or  the  next  lower  grade.  I  am  not  altogether 
satisfied  with  the  method,  and  I  shall  not  enlarge  upon  it  at  this 
point,  but  shall  give  you,  without  further  comment,  a  table 
showing,  for  each  of  the  subjects,  the  median  distances  between 
consecutive  grades,  and  also  the  per  cent  of  pupils  in  each  grade 
who  equal  or  exceed  the  median  of  the  next  higher  grade.  The 
data  for  all  these  determinations  are  from  the  March  tests  only. 
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overlapping 


Median  Diffrkences  in  Terms  of 
THE   "Probable   Error" 


Subject 


Arithmetic. 
Geograpliy. 
History. . .  . 
Grammar.  . 


71-72 

72-8 1 

0.657 

0.641 

0.1.32 

0.428 

0 .  260 

1.096 

? 

0 .  498 

81-82 


0 .  860 
0.845 
0.916 

0.827 


II.     Per  Cent  in  E. 

LCH  Grade  Who 

Equal    or    Exceed     the    Median 

OF  Next  Higher  Grade 

Subject 

71  on  72 

7-  on  81 

81  on  8= 

Aritlimetic.  . 

33 

36 

28 

Geography.  . 

47 

39 

28 

Hi.story 

43 

23 

27 

Grammar.  .  . 

? 

38 

29 

The  foregoing  is  offered  as  an  indication  for  a  method 
of  analysis  of  test  material.  A  few  years  ago  it  was  the  fashion 
to  investigate  methods  of  teaching,  methods  of  organization, 
effects  of  fatigue,  and  the  efficiency  of  individual  teachers,  without 
reference  to  the  nature  of  the  test  material.  The  result  was 
exceedingly  confusing.  No  sooner  did  we  reach  a  conclusion 
than  we  found  ourselves  in  conflict  with  a  different  conclusion, 
ecjually  authoritative.  The  whole  matter  of  experimental  educa- 
tion seemed  to  be  in  a  fog. 

Of  late,  however,  it  has  been  recognized  that  we  are  not  in 
a  position  to  investigate  these  attractive  questions  until  we  have 
taken  the  trouble  to  analyze  the  material  which  we  use.  A  great 
deal  still  remains  to  be  done,  but  so  much  has  been  accomplished 
that  it  offers  a  promise  and  a  prophecy  for  a  much  more  complete 
and  systematic  understanding  of  educational  conditions.  No 
doubt  it  is  much  more  attractive  to  compare  teaching  methods 
than  it  is  to  evaluate  and  standardize,  but  the  latter  work  must  be 
done  first.    We  must  creep  before  we  can  walk. 

In  conclusion,  therefore,  I  revert  to  the  position  which  I  took 
in  the  beginning,  namely,  that  cooperative  effort  is  the  only  means 
by  which  an  abundant  and  satisfactory  standard  material  can  be 
obtained.  No  one  person  and  no  small  group  of  persons  can  cope 
with  the  situation.  The  results  which  I  have  given  you  today 
represent  the  labor  of  many  people,  over  a  long  period  of  time. 
It  is  not  likely  that  conditions  so  favorable  will  often  present 
themselves  to  anyone;  but  if  we  could  have  some  kind  of  an 
association  whereby  we  could  pool  our  results  and  have  them 
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adequately  handled  by  persons  skilled  in  the  sort  of  work  necessary 
to  be  done,  we  could  soon  build  up,  for  all  the  school  sul)jects, 
a  body  of  material  wiiieli  would  enrich  our  kn()wled<>;(>  of  school 
al)ilities  and  processes,  and  dignify  the  name  of  teacher. 


Efficiency  Indices 


B.   R.   Buckingham 


I  am  not  under  any  misapprehension  as  to  the  degree  of  i)oi)U- 
hirity  that  may  be  ascribed  to  the  lecure  of  a  statistician.  Nor 
indeed  have  I  of  late  been  under  any  misapprehension  as  to  the 
degree  of  his  own  popuhirity.  There  are  some  things  which  he 
must  find  out  and  know  and  tell  folks,  but  which  are  not  ahvays 
agreeable  to  those  concerning  whom  the  information  is  given. 

Nor  is  it  always  easy  to  get  this  information.  There  is  a 
certain  glamour  and  glittering  generality  about  the  talk  of  those 
who  lead  you  to  suppose  that  precision  is  easily  attainable  in 
statistics.  This,  I  assure  you,  is  not  the  case.  The  adage  aljout 
the  superlative  degree  of  liars — you  know  it — in  its  application  to 
statistics  has,  as  have  most  adages,  a  basis  of  truth.  I  know  of 
no  greater  lies  than  those  which  can  })e  perpetrated  in  the  name 
of  statistics,  and  I  know  of  no  branch  of  endeavor  which  requires 
more  delicate  handling  in  order  to  bring  out  the  exact  truth 
than  does  the  business  of  statistics. 

It  is,  at  the  outset,  difficult  to  get  information  wdiich  is  reliable. 
This  is  not  always  due  to  the  disinclination  of  peoi)le  to  furnish 
the  facts,  but  is  often  due  to  their  misunderstanding  and  what  we, 
in  somewhat  hasty  moods,  term  their  "stupidity".  Two  and 
two  do  not  invariably  make  four. 

The  simplest  direction  which  you  can  give  to  people  is  not 
so  simple  Init  that  it  will  be  misunderstood  and  evaded  by  some. 
I  had  occasion  to  get  out  a  service  card  in  New  York  City  some 
time  ago;  each  teacher  was  required  to  make  out  a  card,  and  the 
first  item  on  the  card  was  the  teach(>r's  name.  It  never  occurred 
to  me  that  there  could  be  any  tlifficulty  about  Item  1,  altho 
I  did  writ(>  a  direction  concerning  it  because  I  wanted  to  file  tiu^ 
cards  in  an  ali)hal)etical  arrangement  and  therefore  d(>sired  to 
have  the  last  name  appear  first  on  the  lin(^  devoted  to  tiie  name 
of  the  teacher.  I  therefore  took  the  trouble  to  write  a  direction 
on  the  back  of  the  card  in  this  manner:  "Item  1.  Write  your 
last  name  first." 

(85) 
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Several  hundred  cards  came  back  with  the  given  name  written 
first.  I  sent  these  cards  back,  pointing  out  the  error  and  asking 
that  they  be  made  out  in  conformity  with  the  direction  for  Item 
1.  Even  then,  one  teacher  sent  in  her  card  with  the  given  name 
written  first.  I  sent  for  the  teacher,  and  ])lacing  the  card  and  the 
directions  before  lier,  asked  her  to  read  the  first  direction  and  she 
read  it  as  follows:  ''Item  1.  Write  your  last  name  first." 
"Now,"  I  said,  "do  it."  Complying  with  my  request,  she  wrote 
her  last  name  first  but  placed  it  toward  the  right-1  and  end  of  1  he 
line.  Afterwai'ds  she  filled  in  her  first  name  at  the  beginning  of 
the  line. 

The  conversation  that  ensued  was  on(»  in  whicii  she  had  the 
best  of  it.  She  said  that  she  had  written  her  last  name  first,  and 
when  I  said  that  of  course  I  nn^ant  to  have  the  last  name  written 
in  the  first  position,  she  asked  me,  "Why  didn't  you  say  so?" 

Th(^  matter  of  school  re])orting  has  grown  to  be  one  of  pro- 
digious importances  It  has  developed  from  very  small  beginnings 
to  proportions  wlun-e  in  each  of  the  more  advan(!ed  cities  a  large 
staff  of  people  is  employed.  Special  reports  are  likewise  devised 
to  supplement  th(»  regular  report;  and  of  late  we  have  the  school 
survey — a  form  which  is  bcH'oming  cons])icuous  in  the  develop- 
ment of  educational  reporting. 

The  ])uri)ose  of  city  superintendents,  however,  has  been  the 
same  from  the  beginning,  namely,  to  give  to  the  interested  public 
information  concerning  the  efficiency  of  the  schools  for  which 
their  reports  were  rcmdered.  Aside  from  the  descriptive  part  of 
such  re])orts,  the  facts  concerning  registration  have  been  given 
from  the  earliest  days.  The  mere  size  of  the  school  system  was 
properly  felt  to  be  an  important  indication  of  the  extent  to  which 
the  schools  were  carrying  out  the  purposes  for  which  they  were 
organized.  Wlien,  at  a  later  date,  the  facts  concerning  registration 
were  related  to  the  total  population  of  the  area  to  which  the  schools 
belonged,  or  to  the  population  of  school  age,  a  considerable  im- 
provement was  made  in  the  matter  of  school  reporting.  At  an 
early  date,  also,  city  superintendents  began  to  report  figures  show- 
ing the  number  of  pupils  in  attendance,  and  when  these  figures 
were  related  to  registration  figures,  they  became  a  standard 
element  in  school  reports. 

After  a  graded  system  had  become  well  established  and  refine- 
ments had  been  introduced,  the  feature  of  reporting  facts  as  to 
promotion  became  general.  Subsequently,  an  effort  was  made  to 
relate  promotion  facts  to  registration  facts  in  much  the  same  way 
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that  a  relation  had  previously  been  shown  between  attendance 
and  registration. 

Again,  within  the  last  five  or  six  years,  it  has  become  common 
for  school  reports  to  contain  facts  concerning  the  ages  of  children 
with  respect  to  their  grades. 

These  four  steps  in  reporting,  namely,  the  showing  of  regis- 
tration, attendance,  promotion,  and  age  in  relation  to  grade, 
constitute  progressive  steps  in  the  method  of  reporting,  whereby 
a  city  superintendent  offers  an  appraisal  of  the  school  system  of 
which  he  has  charge. 

Running  parallel  with  these  four  kinds  of  reporting,  there 
also  appears  in  many  reports  a  showing  as  to  the  economy  with 
which  the  school  system  is  administered.  This  showing  has 
l)een  developed  in  some  quarters  to  a  remarkable  degree  of  pre- 
cision. It  has  taken  the  form  of  statements  of  unit  cost  based  on 
cost  ])er  pui)il  hour,  cost  per  $1,000  of  assessed  property,  and  cost 
per  capita  of  population.  As  a  further  indication  of  economy  of 
organization,  such  facts  have  also  been  reported  as  average  size 
of  class,  or  ratio  of  the  number  of  teachers  to  the  registration. 

All  these  elements  of  reporting  have  value  as  indicating  the 
efficiency  of  the  school  organization  from  the  administrative 
point  of  view.  They  leave  untouched  the  quality  of  the  teaching; 
nor  are  we  to  suppose  that  any  system  of  schools  is  adequately 
reported  even  when  all  these  elements  are  shown.  They  do,  how- 
ever, constitute  a  physical  basis  of  school  efficiency,  and  as  such 
the}'  are  valuable  and  necessary. 

I  propose,  therefore,  to  show  for  each  of  these  classes  of  facts 
what  I  consider  to  be  the  best  method  of  gathering  the  information 
about  them  and  reporting  it  effectively.  It  is  clear  that  if  we  can 
all  use  the  same  method,  we  shall  gain  greatly  thru  the  opportunity 
for  comparison  as  betw^een  schools  and  school  systems.  Compari- 
sons may  be  odious,  but  nothing  is  more  stimulating  toward 
improvement  in  organization  than  the  knowledge  that  comes  from 
relating  local  conditions  to  conditions  in  other  places.  Com- 
parisons between  classes,  between  schools  of  the  same  system, 
and  between  systems,  cannot  be  neglected,  and,  indeed,  they  lose 
nearly  all  their  odium  when  standards  are  expressly  stated  in 
objective  terms,  and  the  comparison  is  instituted  in  such  a  way 
that  personality  plays  no  part.  But  the  most  effective  of  all 
comparisons  is  the  one  which  compares  the  present  attainment 
of  an  individual  school  or  of  a  group  of  schools  with  the  past 
attainments  of  the  same  school  or  group  of  schools.    A  systematic 
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analysis  carried  out  on  this  basis  is  productive  of  good  effect. 
Effort  with  knowledge  of  results  has  be(ui  demonstrated  to  be 
far  better  than  effort  without  knowledge  of  results. 

The  general  principle  which  underlies  the  statement  of  facts 
as  to  attendance,  promotion,  and  age  is  to  shoiv  actual  conditions 
in  relation  to  possible  conditions.  This  principle  leads,  generally, 
to  the  percentage  form  of  statement.  S])ecifically,  we  express 
the  ratio  of  the  number  of  children  in  attendance  to  the  greatest 
possible  numl)er  who  could  have  attended,  i.e.  to  the  register 
or  number  Ix'longing.  Or,  we  express  the  ratio  of  the  actual  num- 
ber of  promotions  to  the  greatest  number  of  ])romotions  that  could 
have  been  made.  Or,  finally,  we  express  the  ratio  of  the  number 
of  children  at  age  or  younger  to  the  entire  numlxM-  of  cliildreu 
belonging. 

The  matter  of  attendance  presents  little  difficulty.  Remem})er- 
ing  the  principle  that  we  are  to  express  the  ratio  of  actual  to 
possible  conditions,  we  shall  first  find  out  what  the  actual  attend- 
ance is,  and,  second,  what  the  greatest  possible  attendance  miglit 
have  been.  On  any  given  day,  for  a  given  class,  the  attendance 
is  an  objective  fact  which  is  easily  ascertained.  The  registration 
of  the  class  is  equally  well  known,  and  the  ratio  of  attendance 
to  register  for  that  day  and  for  that  class.  To  express  the  same 
fact  for  the  class  over  a  period  of  a  week  or  a  month  or  a  year, 
it  is  only  necessary  to  add  the  attendance  for  each  day  and  the  reg- 
isters for  each  day  of  the  period  in  question,  and  to  divide  the 
first  sum  by  the  second.  What  is  done  for  a  class  may  also  be 
done  for  an  aggregate  of  classes  comprising  a  school,  or  for  an 
aggregate  of  schools  comprising  a  school  system.  In  each  case, 
the  first  term  of  the  ratio  should  be  the  sum  of  all  the  daily  attend- 
ances for  the  group  in  question,  and  the  second  term  should  be  the 
sum  of  all  the  daily  registers  for  the  same  group. 

The  procedure,  therefore,  is  exceedingly  simple.  It  is  not 
always  carried  out,  however,  in  the  manner  indicated.  In  not  a 
few  city  reports,  average  attendance  is  expressed  as  a  percentage 
of  average  register.  This  is  always  bad  in  theory  and  may  be 
decidedly  misleading.  In  any  system  there  are  almost  always 
creations  of  new  classes  during  the  school  year  and  con- 
solidations of  old  ones,  and,  in  very  large  systems,  entire  schools 
are  sometimes  created  or  discontinued.  The  average  attendance 
of  a  class  or  school  which  has  been  discontinued  and  which,  con- 
sequently, has  been  in  session  only  a  portion  of  the  year,  is  based 
upon  a  less  number  of  days  than  the  number  of  days  in  the  school 
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year.  The  same  is  true  of  classes  or  schools  created  duriii.ti;  the  year. 
If  the  aggregate  attendance  of  a  class  which  ran  for  the  first  2") 
days  of  the  school  year  was  1,000,  the  average  attendance  would 
be  40.  For  the  same  class,  the  average  register  might  have  been 
45.  In  arriving,  however,  at  the  attendance  rate  for  the  school 
or  school  system  in  which  the  class  belonged,  it  would  not  be 
proper  to  use  40  and  45  as  elements  in  arriving  at  the  average 
attendance  and  register.  The  only  safe  way  to  compute  the 
attendance  rate  is  to  ascertain  the  aggregate  days  of  attendance 
for  the  group  in  ciuestion  and  to  divide  it  by  the  aggregate  days  of 
register  of  the  group  for  the  given  period. 

Attendance  as  a  criterion  of  efficiency  is  of  fundamental 
importance.  It  is,  to  be  sure,  obscured  by  later  refinements  in 
our  more  highly  developed  school  systems;  but  even  in  them  its 
importance  is  clearly,  altho  perhaps  tacitly,  assumed;  while  in 
less  highly  developed  systems  it  often  becomes  the  most  sig- 
nificant discoverable  fact.  In  the  Maryland  survey  the  authors 
made  no  more  effective  presentation  of  the  insufficiency  of  the 
State  school  system  than  that  in  which  they  showed  the  small 
amount  of  school  attendance.  Other  and  more  refined  measures 
of  efficiency  were  often  lacking,  but  when  it  was  shown  that  the 
attendance  rate  on  total  enrollment  was  52.8  per  cent  in  1880 
and  65.3  per  cent  in  1914,  abundant  evidence  was  afforded  on  the 
one  hand,  that  improvement  had  been  made,  and,  on  the  other 
hand,  that  conditions  were  "still  poor".  From  this  fact  alone 
we  are  prepared  to  find,  as  indeed  we  do  find  in  other  parts  of  the 
Survey,  that  conditions  in  general  indicate  substantially  the 
same  improvement  and  the  same  present  inferiority. 

Again,  when  comparison  is  to  be  made  among  large  numbers 
of  systems,  facts  as  to  attendance  are  among  the  few  bases — apart 
from  financial  ones — upon  which  comparison  may  rest.  In  "A 
Comparative  Study  of  Public  School  Systems  in  the  Forty- 
Eight  States",  the  Division  of  Education  of  the  Russell  Sage 
Foundation  made  a  very  effective  presentation  based  mainly 
on  data  contained  in  the  report  of  the  Commissioner  of  Education 
for  1911.  Attendance  was  one  of  the  facts  considered.  At  the  close 
of  the  report,  the  48  States  were  given  a  general  rank  and  also  a 
rank  in  each  of  the  ten  most  important  educational  facts  already 
considered.  Attendance  was  again  included,  and  its  importance 
as  a  single  criterion  may  be  judged  from  the  fact  that  the  ranking 
of  the   States   on   attendance   and  their   general   ranking  in   the 
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"ten  tests  of  efficiency"  was  sucli  that  the  correlatiun  coefficient 
was  +0.67  ("Foot-ruie"  method). 

The  attendance  rate  is  not,  as  I  have  said,  always  computed 
in  tlie  same  way.  In  the  bulletin  of  the  Russell  Sage  Foundation 
the  attendance  rate  was  taken  directly  from  the  report  of  the 
Commissioner  of  Education  where  the  rate  is  leased  not  on  register 
but  on  enrollment — that  is  to  say,  it  is  ])ased  on  the  total  number 
of  different  children  who  attended  school  any  portion  of  the  year. 
Now,  there  are  a  great  many  children  who  enroll  and  drop  out 
and  a  great  many  others  who  do  not  enroll  until  the  school  yeai- 
has  more  or  less  advanced.  In  a  school  system  where  semiannual 
promotions  take  place,  all  mid-year  graduates  and  all  mid-year 
entrants  belong  to  the  school  but  half  the  year.  If  their  attendance 
were  perfect,  it  would  be  but  50  per  cent  of  the  number  of  school 
days  in  the  year.  Correspondingly,  perfect  attendance  of  all 
pupils  on  register  a  portion  of  the  year  would  be  represented 
by  a  per  cent  less  than  100.  The  method  of  basing  the  attendance 
rate  on  enrollment  ignores  the  fact  that  100  per  cent  should  rc])- 
resent  the  maximum  possible  condition.  In  this  method,  100 
per  cent  does  not  represent  anything  which  can  be  defined.  Stating 
my  criticism  with  reference  to  the  principle  I  have  already  laid 
down,  an  attendance  rate  based  on  enrollment  (total  number  of 
different  children  attending  any  portion  of  the  year)  fails  to 
express  the  ratio  of  actual  to  possible  conditions. 

Tlie  attendance  rate  as  "an  index  of  efficiency  may  appear  to 
you  of  doubtful  validity.  It  may  be  thought  that  local  con- 
ditions affect  the  attendance  rate  in  ways  that  cannot  be  ascribed 
to  administrative  efficiency.  For  example,  small  schools  and 
small  classes  may  be  thought  to  be  favored  in  securing  high  rates 
of  attendance.  In  such  schools,  principals  and  teachers  know 
the  pupils  intimately;  they  commonly  know  their  parents  also; 
they  are  more  or  less  acquainted  with  their  home  conditions. 
Such  knowledge  is  desirable  from  every  point  of  view,  and  might 
be  expected  to  operate  to  the  advantage  of  attendance,  without 
the  result  being  properly  attributable  to  the  character  of  the 
organization  or  administration  of  the  school.  Similarly,  the 
location  of  a  school,  the  economic  status  of  the  community,  the 
prevailing  nationality,  the  average  distance  of  home  from  school 
may  be  thought  to  have  bearing  upon  the  question  of  attendance, 
in  ways  that  make  comparisons  between  schools  difficult  or  unfair. 
The  investigations,  however,  which  have  been  carried  on  in  the 
measurement  of  abilities  in  school  subjects  suggest  that  all  such 
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factors  are  likely  to  be  of  less  importance  than  they  would  be 
tliought  to  be  upon  a  priori  grounds.  The  fact  is  that  super- 
vision, administration,  and  organization  are  words  which  are 
assuming  progressively  greater  importance  in  school  matters, 
"As  the  principal  is  so  is  the  school"  is  more  than  an  epigram. 

So  far  as  I  have  studied  the  question,  it  seems  to  me  that 
the  schools  in  any  given  school  system  may  properly  be  com- 
pared on  the  basis  of  attendance,  whatever  the  factors  with 
respect  to  location,  size,  or  community  conditions  may  be.  In 
particular,  with  reference  to  size,  large  schools  seem  to  be  quite 
as  likely  as  small  schools  to  have  a  high  rate  of  attendance.  In 
New  York  City  there  were  478  elementary  school  organizations 
at  the  close  of  the  year  1914-15.  The  registers  of  these  schools 
ranged  from  22,  for  a  one-room  building  in  a  rural  section  on 
Staten  Island,  to  4,488  for  a  huge  organization  in  a  thickly  settled 
district  in  the  borough  of  the  Bronx.  The  attendance  rate  of  the 
former  was  91  per  cent;  the  attendance  rate  of  the  latter  was 
likewise  91  per  cent.  The  average  attendance  rate  for  schools 
of  less  than  200  pupils  was  88.0  per  cent;  that  for  schools  of  201 
to  400  pupils  was  87.6  per  cent;  and  that  for  schools  of  401  to  600 
pupils  was  89.5  per  cent.  I  have  classified  the  schools,  according 
to  size,  by  steps  of  200.  The  rates  for  these  groups  reach  a 
maximum  for  the  1,201  to  1,400  groups,  where  the  rate  is  91.4 
per  cent.  There  is  a  slight  falling  off  in  the  rates  for  the  very 
large  schools.  In  general,  however,  it  may  be  said  that  instead 
of  the  small  schools  being  favored  in  the  matter  of  attendance, 
the  large  schools  tend  somewhat  to  have  the  higher  rates.  This 
is  probably  due  to  the  factor  of  supervision.  There  is  a  tendency 
for  large  schools  to  be  in  the  hands  of  competent  principals. 

The  relation,  however,  between  attendance  rates  and  sizes 
of  schools  is  best  represented  by  the  correlation  coefficient, 
some  steps  in  the  derivation  of  which  I  shall  now  show  you. 
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Fig.  I.     Correlation  of  Attendance  Rate  with  Size  of  School.      (Hori- 
zontal scale  is  for  attendance  rates;  vertical  scale  is  for  registers  of  schools. ) 


This  chart  (Figure  I)  gives  a  scatter  diagram  of  the  478 
schools  in  New  York  City  to  which  I  have  referred.  Each  dot 
in  the  diagram  stands  for  a  school  whose  size  is  indicated  by  the 
line  caption  and  whose  attendance  rate  is  indicated  by  the  column 
caption.  The  extent  to  which  the  dots  show  a  tendency  to  range 
from  the  upper  left  to  the  lower  right  corner  of  the  diagram  in- 
dicates the  extent  to  which  rate  of  attendance  and  size  of  school 
vary  together.  I  think  you  can  see  from  the  grouping  that  there 
is  a  slight  tendency  for  the  dots  to  arrange  themselves  in  this  way. 
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School. 


This  chart  (Figure  II)  shows  the  same  facts,  except  that  figures 
replace  dots  in  the  squares.  You  can  see  from  the  totals  the 
diaribution  of  the  schools  with  respect  to  size.  The  average 
size  of  school  is  1,467  pupils.  That  is,  it  is  in  the  1,401  to  1,600 
group  (indicating).  There  is  no  mode  or  most  frequent  measure 
at  this  group,  there  being  only  39  of  the  478  schools  whose  registers 
fall  between  1,401  and  1,600.  From  the  number  of  groups  (23  m 
all)  and  from  the  frequencies  of  these  groups,  you  will  readily 
see  that  the  variation  in  the  size^  of  schools  is  great.  The 
average    deviation    is  652  pupils.     The  variation    in    attendance 
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rate,  however,  is  not  very  great.  It  ranges  from  81  per  cent  to 
9G  per  cent.  The  average  is  90.3  per  cent;  and  tlie  average  de- 
viation is  1.63  per  cent. 

From  this  chart  the  Pearson  coefficient  of  correlation  is  found 
to  be  +0.21,  with  a  probaV^Ie  error  of  0.03.  Altho  the  coefficient 
is  low,  nevertheless  when  taken  in  connection  with  its  low  probable 
error  it  is  significant.  The  relation,  tlio  small,  is  direct  and  it  is 
real. 
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Fig.  III.     Frequency  of  Attendance   Rates  (478  schools). 


A  graphic  representation  of  the  distribution  of  attendance 
rates  among  478  school  organizations  may  be  seen  in  this  chart 
(Figure  III).  The  horizontal  scale  is  for  attendance  rates.  The 
vertical  scale  is  for  the  number  of  schools  having  the  indicated 
rates.  The  frequencies  rise  slowly  from  a  single  school  at  81  per 
cent  to  nine  schools  at  86  per  cent  and  nine  at  87  per  cent.  It 
then'rises  rapidly  to  a  mode  at  91  per  cent,  falling  rapidly  to  three 
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schools  at  95  per  cent  and  five  schools  at  90  per  cent.  The  shap(> 
of  the  frequency  surface  is  approximately  normal. 

I  shall  turn  now  to  the  second  of  the  series  of  efficiency  in- 
dices wliich  I  have  chosen,  namely,  the  promotion  rate. 

The  reporting  of  promotion  rates  by  city  superintendents 
has  been  rather  unsatisfactory,  and  comparison  between  conditions 
in  the  various  cities  and  for  various  years  is  quite  impossible, 
owing  to  the  variety  of  methods  employed.  Of  these  methods, 
two  may  be  mentioned  as  the  most  common.  By  the  first  method 
the  ratio  of  the  number  of  pupils  promoted  on  promotion  day  to 
the  number  on  register  on  that  day  is  computed.  The  methotl 
has  no  justification,  except  from  a  statistical  point  of  view.  For 
the  one  day  in  question,  it  meets  the  requirement  of  showing 
the  relation  of  actual  to  possible  conditions.  It  therefore  yields 
a  figure  which  is  valid  for  that  day;  but  it  totally  ignores 
the  fact  that  in  well-conducted  school  systems  every  day  is  pro- 
motion day,  and  that  an  effort  is  made  to  advance  children 
whenever  they  are  judged  to  have  reached  a  point  where  they  can 
profit  by  the  next  higher  grade  of  work.  By  this  method  all 
incidental  promotions  are  neglected;  and  yet  it  is  one  of  the  surest 
signs  of  good  school  management  when  the  numb(>r  of  these 
incidental  promotions  is  large.  A  statistical  treatment  which 
leaves  them  out  of  account  fails  to  include  all  the  facts. 

The  second  method  which  is  commonly  employed  in  educa- 
tional reports  consists  of  adding  the  number  of  incidental  pro- 
motions to  the  number  at  the  end  of  the  term,  or  year,  and  dividing 
this  sum  by  the  register  on  the  last  day  of  the  term,  increased 
by  a  number  equal  to  the  numl^er  of  incidental  promotions. 
In  other  words,  it  is  end-term  promotions  plus  incidental  pro- 
motions, divided  by  end-term  register  plus  incidental  promotions. 
There  is  absolutely-  no  statistical  justification  for  this  method. 
It  is  true  that  the  first  term  of  the  ratio  includes  all  promotions, 
but  the  second  term  certainly  does  not  represent,  as  it  should, 
all  the  possible  promotions.  In  fact,  it  is  a  figure  for  which  there 
is  no  reality. 

The  method  arose  from  the  employment  of  an  intermediate 
one  by  which  all  promotions  occurring  during  and  at  the  end  of 
the  term  were  divided  by  the  register  at  the  end  of  the  term. 
By  this  means  it  frequently  happened  that  the  number  of  pro- 
motions was  greater  than  the  end-term  register,  with  the  result 
that  the  rate  of  promotion  was  shown  to  be  greater  than  100 
per  cent.     It  was  to  avoid  this  result  that  the  end-term  register 
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was  increased  l)y  the  iiuinher  of  incidental  ])i'<)niotions.  The 
effect  is  not  always  to  yield  a  rate  less  than  100  per  cent,  i)articu- 
larly  when  son'e  of  the  ])ui)ils  skip  a  ^rade  at  the  end  of  the 
term. 

The  ])rol)lein,  however,  will  be  considerably  siiii|)line(l  if  we 
take  account  of  the  princi])l(>  1  have  stated,  namely,  that  the 
relation  of  actual  to  i)ossible  conditions  should  be  shown.  In 
a]iplyin<i  this  iirincii)le  the  first  attcMupt  should  be  to  get  a  rej)ort 
of  the  actual  cornlitions.  We  siiall  n(>ed  to  know  the  actual  num- 
ber of  promotions  made.  This  is  not  difficult.  But  we  must 
bear  in  mind  that  we  arc  to  show  actual  conditions  in  relation  to 
possii)le  conditions.  How  does  the  pro. not  ion  of  each  child 
relate  to  what  mif>;ht  ])Ossibly  have  been  done?  Clearly  when 
a  child  is  promot(Ml,  as  an  actual  fact  in  relation  to  the  l)(\st 
possil)le  result  that  could  have  been  obtained,  it  makes  a  ix,rvdi 
deal  of  difference  how  long  he  has  been  on  register  in  the  tirade 
concerned.  There  is  a  slight  theoretical  possibility  for  a  child  to 
l)e  ])romoted  after  liaving  been  a  single  day  in  a  class  (a  day 
being  the  smallest  time-unit  we  use  in  school  reporting).  I 
have  known  children  to  be  advanced  to  the  next  higher  grade 
after  a  day  in  a  class.  Such  an  advancement  is  scarcely  a  pro- 
nu)tion  in  the  usual  sens(\  It  hardly  tak(\s  j)lace  except  in  the 
case  of  a  newly-admitted  child  who  was  wrongly  placed  at  first. 
But  thes(>  things  happen  and  they  are  usually  called  promotions 
in  the  report.  My  judgment  is  that,  all  things  considered,  they 
sliould  be.  It  is  impossible  to  lay  down  a  rule  as  to  how  long  a 
time  must  elapse  before  an  advancement  to  a  higher  grade  may 
be  reported  as  a  ])romotion. 

It  appears,  then,  that  there  is,  under  cei-tain  circumstances,  a 
possibility  of  promotion  after  a  child  has  belonged  to  a  class  one 
day.  This  possibility  increases  as  the  days  go  by  until  it  becomes 
a  strong  probability  for  the  child  who  has  belonged  to  the  class 
every  day  of  the  term.  It  is  evident,  therefore,  that  there  is  a 
sense  in  which  one  promotion  is  not  equal  to  another  promotion. 
The  promotion  of  a  child  who  has  been  on  register  two  months  of 
a  term  is  not  the  same  as  that  of  a  child  who  has  been  on  regi.ster 
all  the  term.  It  is  possible  and  quite  practicable  to  weight  each 
promotion  by  the  number  of  days  that  the  promoted  child  has 
been  on  the  register  of  the  class  from  which  he  was  promoted. 
The  effect  of  this  I  shall  show  you  in  a  minute. 

Meanwhile,  obtaining  the   actual  conditions  will  involve  two 
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things:    first,  the  fact  of  promotion;  and,  second,  tlie  numl)er  of 
(Uiys  of  register  for  each  child  promoted. 

The  method  of  reporting  in  every  school  system  should  embody 
short-term  reports — say  monthly — on  which  the  significant  facts 
for  each  school  may  be  gathered  at  the  central  office  for  current 
use.  I  myself  have  found  these  short-term  reports  to  be  the 
best  source  for  making  up  the  usual  annual  report,  by  so  devising 
them  that  the  facts  required  at  the  end  of  the  year  may  be 
accumulated  as  the  monthly  reports  come  in.  This  method  has  the 
advantage  not  only  of  keeping  data  on  hand  currently,  but  it  has 
also  tlie  added  advantage  of  not  requiring  principals  or  teachers 
to  make  out  annual  reports  on  facts  which  they  have  already 
reported  during  the  year. 

Whether  such  a  plan  is  in  operation  or  not,  there  may  be 
provided  on  the  form  on  which  the  teacher  makes  daily  entries 
a  column  or  item  calling  for  the  number  of  children  promoted 
from  the  class  each  daj',  and  another  requiring  that,  if  one  or  more 
children  are  shown  as  promoted  on  any  given  day,  the  aggregate 
days  of  their  register  in  the  grade  should  be  shown.  The  principal 
can  then  easily  transfer  to  his  report  these  entries  for  promoted 
pupils  and  aggregate  days  of  register.  Thus  a  statement  of  actual 
conditions  is  given. 

The  possible  conditions,  however,  are  not,  in  the  case  of 
promotions,  a])SoIutely  definal)le.  By  admitting  possibilities 
remote  enough,  an  indefinite  number  of  promotions  may  be  re- 
garded as  possible.  For  a  school  or  a  school  system  the  possil)le 
conditions  may  very  well  be  represented  for  each  child  by  his 
total  days  of  register  in  the  grade  for  the  term.  Advancement 
from  one  grade  to  the  next  is,  from  the  usual  point  of  view,  an 
indication  that  the  work  of  the  grade  from  which  the  advance- 
ment takes  place  has  been  completed.  This  means  that  the 
child  lias  completed  as  many  days'  work  as  the  term  contains. 
If  he  has  been  on  the  register  of  the  grade  the  entire  term  and  is 
promoted,  his  period  of  belonging  and  his  advancement  (measured 
in  days)  are  the  same.  If  a  child  was  on  register  less  than  the 
number  of  days  in  the  term,  the  days  should  be  reported  and  used 
in  the  estimate  of  possible  conditions,  for  such  a  child  had  some 
chance  of  promotion  and  his  chance  was  greater  the  longer  he 
was  on  the  register.  It  is  one  of  the  greatest  weaknesses  of  the 
present  methods  of  reporting  concerning  promotions  that  no 
account  is  taken  of  the  children  who  drop])ed  out  during  the  term 
without    having    been    advanced.      Any    uund)er    of    tlu^se    may 
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take  place,  and  the  promotion  rate  will  not  be  affected.  I  have 
known  of  instances  where  pupils  not  maintaining  themselves 
were  induced  to  leave  school  just  before  the  end  of  the  term, 
in  order  that  the  promotion  rate  might  not  be  diminished  by  the 
fact  of  their  being  on  register  at  the  end  of  the  term. 

By  the  method  I  am  proposing,  the  promotion  rate  would 
equal  the  aggregate  days  of  register  of  all  promoted  pupils 
divided  by  the  aggregate  days  of  register  of  all  pupils  for  the 
grade  and  period  in  question.  Of  course,  all  pupils  transferred 
from  one  class  to  another  within  the  same  grade  should  carry 
to  their  new  class  their  days  of  register  in  the  class  (or  classes) 
to  which  they  have  previously  belonged  during  the  term.  An 
illustration  may  be  given  of  how  this  method  would  register 
conditions  more  truly  than  do  the  mc^thods  now  in  use.  Sup])ose 
a  class  to  have  consisted  of  40  pu])ils  at  the  beginning  of  a  term 
of  100  days.  Suppose  that  one  ])upil  dropped  out  after  belonging 
10  days;  another  after  belonging  25  days;  and  a  tiiird  after 
belonging  7.5  days;  and  that  of  the  remaining  37  all  were  promoted 
during  the  term,  no  incidental  promotions  having  been  made. 
The  register  at  the  end  of  the  term  is  37;  and  the  nundxu'  of 
])roniotions  is  37.  By  both  the  methods  commonly  used,  the 
j^romotion  rate  would  be  100  i)er  cent.  Observe,  however,  that 
this  leaves  wholly  out  of  account  the  possibility  involved  in  the 
three  children  who  wcu'e  (lro])]ie(l  and  not  promoted,  in  some 
way,  these  should  a])pear  in  the  second  term  of  the  ratio.  The 
extent  to  which  they  should  appear  is  precisely  indicated  jjy  the 
number  of  days  each  one  of  them  belonged  to  the  scluxjl.  The 
first  term  of  the  ratio  would  be  3,700,  the  aggregate  days  of  register 
of  the  promoted  pupils;  the  second  term  of  the  ratio  would  be 
3,700  +  10  +  25  +  75,  or  3,810;  and  the  promotion  rate  would 
be  97  per  cent.  I  maintain  that  this  is  a  truer  expression  of  the 
condition  than  the  100  per  cent  rate  that  the  methods  now  in  use 
would  yield. 

The  fact  is  worth  noting  that  this  method  automatically 
takes  care  of  the  puzzling  question  of  what  the  unit  should  be 
in  reporting  promotions,  i.e.  whether  the  unit  is  the  child  pro- 
moted or  the  fact  of  advancement.  If  a  child  is  advanced  two 
grades  either  at  the  same  time  or  successively,  does  this  count 
as  one  or  as  two,  in  reporting  promotions?  By  the  method 
indicated  here,  it  would  count  as  two,  and  each  successive  ad- 
vancement would  show  in  the  report  of  the  grade  from  which 
the  advancement  took  place.     When  a  child  is  promoted  two 
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grades  at  the  same  time  it  will  be  better  to  regard  the  child,  for 
record  purposes,  as  for  a  time  (say,  one  day)  in  the  grade  over 
which  he  skips.  As  a  matter  of  fact,  double  promotions  seldom 
take  place,  and  when  they  do  take  place,  it  is  almost  always 
at  the  close  of  a  term.  Under  such  circumstances,  a  child  has 
probably  been  prepared  for  the  double  advancement  by  being 
instructed  in  the  work  of  the  grade  he  is  about  to  skip.  The 
lime  devoted  to  this  advanced  instruction  may  very  properly 
be  reported  as  time  in  the  grade  to  be  skipped. 

The  usefulness  of  promotion  rates  as  indices  of  efficiency 
may  be  illustrated  from  material  which  came  to  my  hand  while 
I  was  at  New  York.  I  obtained  promotion  rates  of  the  478  school 
organizations  for  the  year  1914-15,  and  related  them  to  the  sizes 
of  schools,  as  well  as  to  the  attendance  rates  and  the  rates  of 
overageness.  The  next  chart  presents,  graphically,  the  general 
relation  which  exists  between  size  of  school  and  promotion  rate.* 
It  is  evident  that  large  schools  are  quite  as  likely  to  have  high 
promotion  rates  as  are  small  schools.  The  average  rate  of  pro- 
motion for  schools  smaller  than  the  average  size  was  8(i.8;  while 
that  of  schools  larger  than  the  average  size  was  88.1. 


*Not  shown  in  this  report. 
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f or  registers  of  schools. ) 


This  chart  (Figure  IV)  is  a  correlation  table  for  promotion 
rate  and  size  of  school.  From  it,  the  Pearson  coefficient  turns 
out  to  be  +0.17,  with  a  prol^able  error  of  0.03.  Whatever 
relationship,  therefore,  exists  between  size  of  school  and  promotion 
rate  is  a  direct  one,  altho  it  is  too  small  to  be  of  much  conse- 
quence. 


Educational  Measurements 


101 


J6- 

J9- 
6/ 

62- 
64 

63- 

67 

68- 

70 

71- 
7J 

74- 
76 

77- 
79 

80- 
82 

83- 
85 

86- 
88 

89- 
91 

92- 
94 

95- 
97 

98- 
lOO 

80 

81 

1 

1 

82 

1 

1 

2 

83 

/ 

1 

2 

4 

84 

1 

1 

1 

3 

83 

1 

2 

4 

/ 

8 

86 

3 

4 

2 

9 

87 

3 

1 

3 

1 

/ 

9 

88 

3 

13 

9 

/O 

4 

1 

4Z 

89 

1 

2 

3 

10 

16 

15 

8 

2 

37 

90 

/ 

6 

21 

39 

19 

/6 

2 

104 

91 

/ 

^ 

9 

17 

23 

36 

17 

4 

1 

1/4- 

92 

1 

2 

7 

7 

22 

/3 

3 

2 

1 

62 

93 

3 

8 

7 

13 

3 

2 

2 

38 

94 

/ 

3 

4 

6 

2 

1 

17 

93 

1 

1 

1 

3 

96 

2 

2 

1 

3 

1 

1 

/ 

/ 

// 

40 

91 

134 

122 

J8 

/4 

4 

47 Q 

Fig.    V.     Correlation    of   Attendance    with 
scale  is  for  promotion  rates;  vertical  scale  is 


Promotion.      (Horizontal 
for  attendance  rates.) 


An  interesting  question  as  to  the  relation  between  attendance 
and  promotion  arises.  A  correlation  table  for  these  facts  is  shown 
on  the  arnexed  chart  (Figure  V) ;  and  from  it  the  Pearson  coefficient 
is  found  to  be  +0.15;  the  P.E.  is  0.03.  Thus  it  is  shown  that 
there  is  a  slight  tendency  for  schools  having  high  rates  of  attend- 
ance to  have  high  rates  of  promotion  also.  It  may  seem  surprising 
that  the  tendency  is  not  stronger.  In  fact,  I  think  that  most  per- 
sons would  have  supposed  that  the  correlation  would  be  much 
higher  than  is  indicated.  As  indices  of  efficiency,  however,  tliere 
is  licrc  a  relative  independence  which  shows  the  caution  which 
should  be  observed  in  drawing  inferences  as  to  the  efficiency  of 
organization  in  a  school  system  from  a  single  feature. 
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Since  the  miinbcr  of  children  in  attendance,  in  relation  to 
the  register  of  a  school,  implies  little  as  to  tlie  proportion  of  chil- 
dren promoted,  it  is  obviously  necessary  to  ol)tain  both  rates. 
This  shows  quite  clearly  that  no  single  statement  may  be  taken 
as  sufficient  indication  of  desiral)lc  organization.  The  average 
rate  of  attendance  in  the  New  York  schools  was,  for  the  year 
1914-15,  90.3  per  cent.  Tliis  must  l)e  taken,  therefore,  as  in- 
dicating nothing  more  than  it  pretends  to  indicate,  namely,  a 
certain  amount  of  efficiency  in  securing  the  presence  of  children 
at  school.  It  implies  little  or  nothing  in  regard  to  anything 
else.  It  must  be  taken  by  itself.  The  rate  of  promotion  for 
the  New  York  schools,  for  the  same  year,  was  88.5  per  cent. 
This  figure,  likewise,  must  be  taken  as  indicating  nothing  inore 
than  the  extent  to  which  children  were  advanced  in  the  grades. 
It  is  so  easy  to  draw  from  statistics  inferences  which  are  not 
warranted  that  this  caution  is  woiih  emphasizing.  In  this  case, 
as  in  so  nuiriy  others,  figures  must  be  taken  for  what  they  mean, 
without  implications  as  to  anytliing  else,  unless  the  imi)lications 
themselves  have  been  established. 

On  the  other  hand,  it  must  not  be  assumed  that  there  is  any 
opposition  betwcM'u  desiral)le  attendance  rates  and  desirable 
])r()motion  I'ates.  It  is  true  that  the  correlation  is  low,  being, 
as  I  have  said,  only  +0.15,  but  the  ])robable  error  is  likewise 
low,  being  only  0.03.  The  coefficient,  therefore,  is  five  times  the 
j^robable  erroi",  which  is  more  than  enough  to  establish  the 
existence  of  relationship.  The  points  to  be  borne  in  mind  are: 
First,  that  favoral^le  attendance  conditions  do  not  necessarily 
imply  favorable  promotion  conditions.  Each  index  is  itself 
independently  necessary  in  the  estimate  of  school  organization. 
Second,  there  is,  on  the  other  hand,  no  opposition  between  these 
characteristics;  but  there  is  an  unmistakable  tendency,  discover- 
able among  a  large  number  of  schools,  for  these  favorable  con- 
ditions to  be  found  together. 
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The  arjiiexed  chart  (Figure  VI)  shows  the  distribution  of  schools 
at  New  York,  according  to  their  rates  of  promotion.  Observe 
that,  with  the  exception  of  two  schools  whose  promotion  rates 
were  very  low,  the  surface  is  substantially  that  of  a  normal 
frequency  surface  of  small  variability.  Observe  that  the  median 
school  has  a  rate  of  87.6  per  cent,  altho  the  promotion  rate  for 
the  city,  taken  as  a  whole,  was,  as  I  have  said,  88.5  per  cent. 

An  examination  of  the  promotion  rates  as  reported  for  cities 
in  the  United  States  of  over  300,000  inhabitants  shows   that  10 
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of  these  cities  report  promotion  rates  based  on  the  niiml)er  of 
end-term  promotions  divided  l)y  the  end-term  register.  The 
rates  for  these  cities  range  from  80.8  i)er  cent  for  Philach'lphia 
to  93.6  for  Seattle.  The  median  condition  is  represented  by  New- 
York,  at  88.5  per  cent,  and  Boston,  at  87.4  per  cent.  Probably 
it  is  a  safe  statement  to  make  that  the  promotion  rates  by  the 
end-term  method,  for  th(>  largest  cities  of  the  country,  is  about 
88  per  cent.  The  rate,  in  general,  has  been  rising  steadily  ever 
since  it  has  become  a  matter  of  reporting,  as  is  usually  the  case. 
About  ten  years  ago  the  rate  was  not  much,  if  any,  more  than 
80  per  cent.  The  city  superintendents  of  ])ut  four  of  i]\v  cities 
of  this  class  report  promotions  based  on  the  register  ])lus  in- 
cidental promotions.  These  four  cities  arc  Milwaukee,  89.5  ])('r 
cent;  New  York,  88.8  per  cent;  Philadelphia,  85.8  per  cent;  and 
Newark,  83.0  per  cent.  The  rate,  in  general,  by  this  method, 
is  probably  about  88.5  per  c(>nt. 

Passing  now  to  the  consideration  of  the  ages  of  pupils  with 
respect  to  grade,  it  may  be  stated  at  the  outset  that  this  feature 
of  city  school  reporting  is  the  most  recent  of  those  which  we  have 
been  considering.  It  was  in  1904,  that  ('ity  Superintendent 
Maxwell  of  New  York  made  the  first  sy.stematic  beginning  of 
this  kind  of  reporting.  At  the  end  of  the  school  year  1903-04, 
there  were  registered  in  the  elementary  schools  of  that  city 
491,674  pupils,  and  the  number  of  overage  ])U])ils  was  shown 
to  be  192,143,  or  39.0  per  c(nit  of  the  registration.  The  reports 
of  no  other  city  offer  so  long  a  pei'iod  of  years  over  which  com- 
parisons may  be  made  with  respect  to  overageness.  Beginning 
in  1904  with  39.0  per  cent,  the  rate  of  ov(M-ageness,  computed 
by  the  ni(»thod  then  used,  has  steadily  diminished,  until  it  reached 
19.1  ])er  cent  in  1915.  This  means  that  whereas  in  1904  practically 
2  children  out  of  5  were  too  old  for  their  grades,  in  1915  but  1 
child  in  5  was  too  old  for  his  grade.  In  other  words,  in  the  ])(»riod 
of  1 1  years,  the  per  cent  of  overage  children  has  been  cut  in  half. 
This  is,  of  course,  on  the  assumption  that  the  method  of  reporting 
used  in  1904  is  unchanged.  The  method  used  at  that  time  was 
as  follows:  The  ages  of  children  were  taken  on  June  30 — the  last 
day  of  the  school  year — after  the  pupils  had  been  promoted  to 
their  new  grades.  In  the  first  grade,  children  were  called  "over- 
age" if  they  were  over  8  years  of  age;  in  the  second  grade  if  over 
9;  in  the  third  grade  if  over  10,  etc. 

The  method  in  New  York,  however,  has  twice  been  changed, 
and  each  time  in  the  direction  of  adopting  a  more  severe  standard. 
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The  last  change  was  introduced  in  the  school  year  1914-15,  and 
whereas  the  rate  on  the  original  basis  was.  as  stated,  19.1  per  cent, 
the  rate  on  the  new  basis  for  the  same  ])upils  was  M.Q  per  cent. 
This  serves  to  indicate  how  inportant  it  is  to  define  the  method 
of  handling  the  overage  question. 

Before  passing  to  a  description  of  the  present  method  in  use 
in  New  York,  it  may  be  well  to  point  out  that,  as  in  the  case  of 
])romotion  rates,  so  in  the  case  of  the  rate  of  overageness,  a 
marked  improvement  of  conditions  follows  as  soon  as  the  matter 
becomes  one  of  systematic  reporting.  No  one  will  suppose  that 
if  the  attention  of  principals  and  superintendents  had  not  thus 
been  called  to  this  matter,  the  rate  of  overageness  would  have 
been  decreased  by  half  in  eleven  years.  I  can  state  positively, 
of  my  own  experience,  that  no  official  pressure  was  brought  to 
bear  upon  principals  of  schools  to  decrease  the  amount  of  over- 
ageness, other  than  the  publication  of  the  rates.  For  the  first 
nine  years  of  the  period,  the  rates  were  published  only  for  the  city 
and  for  each  of  the  five  boroughs  of  the  city.  For  the  past  two 
years,  they  have  been  given  for  individual  schools. 

I  shall  now  describe,  in  some  detail,  the  method  which  I  have 
used  for  gathering  statistics  in  regard  to  the  ages  of  children. 
A  few  guiding  principles  may  be  stated,  as  follows: 

1.  It  is  desirable  to  receive  the  information  directly  from  its 
source. 

2.  All  tabulations  should  be  made  at  the  central  ofhce,  under 
the  direction  of  a  person  trained  for  this  kind  of  work. 

3.  The  record  of  the  ages  of  children  should  be  taken  at  the 
time  when  the  problem  of  adjustment  arises  and  when  rcunedial 
measures  may,  therefore,  be  taken. 

4.  The  standard  should  be  such  that  children  are  regardcHl 
as  overage  if  they  are  not  in  the  way  of  being  graduated  by  the 
time  they  reach  the  age  of  fifteen. 

5.  The  central  office  should  promptly  report  to  iM-incipals 
and  teachers  the  rates  for  their  schools  and  classes,  aud  shouhl 
make  available  to  them  all  the  supporting  data. 

These  principles  are,  for  the  sake  of  clearness,  stated  in  some- 
what dogmatic  form.  The  principle  of  receiving  tht;  material 
directly  from  its  source  means  that  the  record  of  the  ages  should 
be  taken  by  the  teacher,  from  the  register,  as  th(>  primary  source 
of  the  material,  and  the  record  should  ])e  received  at  the  central 
office,  as  made  by  the  teacher.     The  report  for  the  school  will, 
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therefore,  consist  of  as  many  r(>ports  as  tlun-e  are  teachers  in 
the  school.* 

The  advantage  of  receiving  the  information  as  nuuU'  out  by 
the  teachers  is  obvious.  Richness  of  detail  is  afforded  which  could 
not  be  obtained  if  the  reports  were  tabulated  by  the  princii)al 
for  the  school  and  forwarded  as  a  school  report.  Error  in  tabula- 
tion at  the  schools  is  avoided;  and  in  large  systems  where  tabula- 
tions would  be  carried  out  in  many  different  schools,  the  amount 
of  this  error  would  be  considerable. 

The  problem  of  adjustment  referred  to  in  the  third  principle 
takes  place  at  the  time  of  the  reorganization,  due  to  promotion, 
at  the  beginning  of  the  term  or  year.  It  is  at  that  time  that  the 
ages  of  pupils  should  be  taken.  A  copy  of  the  class  report  should 
be  retained  by  each  teacher,  for  her  information.  Indeed,  most 
teachers  will  indicate  in  their  I'oU-books  the  fact  that  a  child  is 
overage.  Thus  this  sj^stem  of  reporting  not  only  brings  the  prob- 
lem to  the  attention  of  teachers  at  the  time  classes  are  organized, 
but  it  also  enables  each  teacher  to  make  the  precise  application 
of  the  problem  to  individual  pupils. 

The  standard  set  in  the  fourth  principle  is  called  the  "up- 
to-fifteen"  standard.  Of  course,  an  up-to-fourteen-and-a-half 
standard,  or  an  up-to-fourteen  standard  may  be  used.  None  of 
the  larger  cities  in  the  country  are  using  a  standard  more  rigorous 
than  the  "up-to-fifteen"  standard.  The  justification  for  it  lies 
in  the  fact  that  compulsory  education  laws  generally  require  the 
attendance  of  children  up  to  the  age  of  fourteen,  and  if  a  child 
has  reached  the  eighth  grade  not  later  than  his  fourteenth  birth- 
day, there  is  strong  likelihood  of  his  remaining  until  graduation. 
It  is  a  fact,  also,  that  the  elementary  school  curriculum  is  devised 
upon  the  assumption  that  children  will  begin  school  at  6  years 
of  age  and  be  graduated  when  tliey  are  14,  \a\  before  their  fifteenth 
birthday. 

The  plan  which  I  am  suggesting  will,  therefore,  recjuire  a 
report  from  each  teacher  at  the  beginning  of  each  term  (or  year, 
if  promotion  takes  place  yearly). 


*lf  more  than  one  grade  is  taught  by  a  given  teaclier,  tiie  teaclicr  should  render 
a  report  for  each  grade  in  her  charge. 
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Fig.  VII.     Age  Table. 

This  chart  (Figure  VII)  shows  the  form  of  report  which  is  being 
required  from  the  New  York  City  teachers.  It  represents  an 
evolution,  and  is  itself  likely  to  be  changed.  The  principle,  how- 
ever, is  clear.  The  teachers  are  not  called  upon  to  record  tlie 
ages  of  the  children,  but,  rather,  their  dates  of  birtli.  This  is  a 
detail  which  is  worth  considering.  It  was  adopted  because 
teachers'  roll-books  showed  dates  of  birth,  instead  of  ages.     I 
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found  that  a  form  of  report  callinji;  for  the  a^os  of  pupils  intro- 
duced a  j>;reat  deal  of  error,  due  to  tli(>  faet  that  teachers  cannot, 
with  anything  aj)]n-oachin<2;  uniform  accuracy,  subtract  the  date 
of  birth  of  a  child  from  a  ji;iven  date  at  the  end  of  the  term. 
Accordinjily,  all  that  is  required  on  the  blank  shown  in  this  chart 
(Figure  VII)  is  that  a  teacher  enter  a  score-mark  for  each  i)upil 
opposite^  the  year  and  under  th(>  month  of  his  birth,  the  days  of 
the  month  being  neglected.  After  ent(>ring  the  score-marks  for 
the  dates  of  birth  of  pupils  these  are  counted  and  entered  in  the 
columns  headed  "First  Totals"  and  "Second  Totals".  For  the 
purifose  of  checking  the  work,  vertical  totals  are  also  entered, 
and  the  footings  of  the  first  totals  and  second  totals  taken  together 
should  ecpial  the  registei-  at  the  close  of  the  (la>'  on  the  date  of  the 
report. 

You  will  notice  that  first  and  second  totals  are  called  foi-. 
The  reason  for  this  is  that  l)y  so  doing  the  number  of  ])ui)ils 
born  within  each  of  the  two  six-months'  periods  corresponding 
to  the  half-years  of  school  may  be  show  n  for  any  year.  Since  the 
calendar  year  does  not  correspond  to  the  school  year,  the  matter 
of  gathering  the  numbers  of  children  l)orn  in  the  different  months 
is  not  as  simple  as  it  might  at  first  a])pear,  unless  we  arc^  willing 
to  re-group  tlu^  children  at  the  central  office  and  to  lose  the  natural 
groujung  which  this  table  affords.  Permit  me  to  show  you  what 
I  mean  by  the  "natural  groujiing".  Suppose  this  blank  to  have 
been  made  out  for  the  second  half  of  the  present  school  year, 
and  suppose,  further,  that  it  has  been  made  out  by  a  teacher  of 
the  first  half  of  the  first  grade.  Altho  the  report  will  have  been 
made  out  at  the  beginning  of  the  term,  which,  in  New  York, 
would  be  February  first,  the  ages,  as  I  have  just  stated,  are  to  be 
com]mted  to  the  end  of  the  school  year,  i.e.  to  July  31.  There- 
fore, what  we  wish  to  know  is  the  number  of  pupils  who  will  he 
over  71^  years  of  age  by  July  31,  1916.  All  such  pupils  are  over- 
age in  the  first  lialf  of  the  first  grade.  Pupils  will  })e  lYz  years  of 
age,  or  older,  on  July  31,  1916,  if  they  were  born  on  or  before 
January  31,  1909.  If  a  teacher  of  a  class  in  the  lower  first  grade, 
after  scoring  the  ages  of  her  pupils  on  this  blank,  draws  a  line 
straight  across  here  (indicating  the  line  between  1908  and  1909), 
all  the  pupils  whose  ages  are  scored  below  the  line  will  be  over- 
age, and  all  those  scored  above  the  line  will  be  at  age  or  younger. 
If  she  draws  a  line  here  (indicating  the  line  between  1909  and 
1910),  she  will  inclose  all  the  children  in  her  class  who  are  of  normal 
age,   adopting  632  to  73^2  as  being  normal.     In  the  same  way, 
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a  teacher  of  any  grade  may,  after  scoring  the  ages  of  tlie  pui)ils, 
mark  off  thos(>  who  are  overage,  those  who  are  normal,  and  those 
wlio  are  luuk'rage.  In  the  form  as  used  at  New  York,  information 
is  given  on  the  hack  to  show  liow  this  may  be  iU)ne. 

There  is  an  adckxl  advantage  in  having  the  (kites  of  birth 
rather  than  the  ages  of  chikh'en  mack^  the  l)asis  of  the  reporiing. 
Wlien  ages  are  to  l)e  reported  and  the  teacher  works  from  (kites 
of  birth,  she  has  to  make  thirty  or  forty  subtractions  in  filHng 
out  the  report.  When  the  (kites  of  birth  are  (hrectly  reporteck 
all  children  who  were  born,  say,  in  August,  1908,  of  whom  there 
may  be  hundreds  or  thousands,  are  recorded  as  to  their  ages, 
by  a  single  sul)traction,  there])y  enormously  reducing  the  amount 
of  labor  involved.  The  principle  of  calculating  ages  to  the  end  of 
the  term  stresses  the  problem  to  be  met,  namely,  the  completion 
of  the  elementary  school  course  before  the  fifteenth  birthday, 
or  the  completion  of  any  grade  of  work  before  the  age  correspond- 
ing to  the  grade.  We  therefore  desire  to  secure  the  ages  of  ]m])ils 
at  the  end  of  the  term  or  year  while  taking  the  count  at  the  be- 
ginning of  it.  This  is  not  usually  done,  but  it  presents  no  difficulty, 
and  it  has  at  least  one  advantage  which  has  not  been  mentioned. 
It  automatically  takes  account  of  pupils  who  dro]i  out  during  the 
term. 

It  has  been  a  matter  of  criticism,  in  Cit.y  Sui)erint(nident 
Maxwell's  reporting  on  age  conditions,  that  he  did  not  show  the 
ages  of  the  "thousands  of  children"  who  were  dropped  from  the 
register  during  the  year.  By  taking  the  count  at  the  beginning 
of  the  term,  all  such  ]Hipils  are  recorded.  This  method  was  fol- 
lowed last  year.  The  result,  however,  indicated  that  there  was 
no  bias  to  be  inferred  from  the  fact  that  in  former  years  pupils 
who  left  school  had  been  omitted  from  the  count.  It  will  readily 
occur  to  you  that  by  taking  the  count  at  the  beginning  of  the 
term  we  are  out  of  the  frying-pan  and  into  the  fire,  because, 
while  including  those  who  drop  out,  we  exclude  those  who  are 
admitted  subsequent  to  the  beginning  of  th(>  term  or  y(>ar.  With 
a  view  to  testing  the  extent  to  which  the  reporting  of  nvw  ad- 
missions was  worth  while,  I  jirovided,  last  year,  that  the  teachers 
should  retain  a  copy  of  the  report  forwarded  to  the  city  sup(>r- 
intendent  at  the  beginning  of  the  term,  and  that  for  all  new  ad- 
missions after  the  report  was  made  out,  the  ages  should  be  scored 
in  red.  At  the  end  of  the  term,  a  copy  of  the  teacher's  retained 
blank,  with  the  original  and  red  scorings,  was  forwarded  to  the 
city  superintendent's  office.     This  is  a  detail  which  can  easily  be 
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provided,  if  anyone  cares  to  do  so.  I  did  not  find  last  year  tliat  the 
method  of  reporting  the  ages  of  new  admissions  yiel(hMl  significant 
data.  There  is  apparently  no  material  difference  between  tlie  age 
groupings  of  the  admitted  pu])ils  and  of  tlie  pupils  on  register 
at  the  beginning  of  the  term. 

Permit  me  to  dwell  for  a  moment  upon  an  advantage  wliicli 

follows   from    this    method    of    gathering    information    in    regard 

to  the  ages  of  children  in  res])ect  to   grade.      I   have  suggested 

that  by  getting  the  reports  directly  from  the  teachers,  a  richness 

of  detail  is  possible  which  is  lost  when  the  reports  are  summarized 

at  the  schools.     No  system  of  reporting  with  which  I  am  familiar 

dividers  the  ages  of  children  into  any  fincv  steps  than  half-years. 

This  blank  permits  the  tabulation  of  the  ages  of  children  by  y(>ars 

and  months.    Probably  in  most  cases  it  will  not  be  found  advisabh' 

to  tabulate — much  less  to  print — the  ages  of  chihlren  as  accurately 

as  this,   but,   for   many  purposes — particularly  for  the  principal 

at  the  school  and  the  class  teacher — it  is  exceedingly  important 

to  know  just  how  much  the  children  are  al)ove  normal  age.      It  is 

always  found,   when   age-grade  statistics  are  r(>ported,   that  the 

largest    group    among    the    overage    children    is    the    group    next 

older  than  the  upper  limit  of  normal  age.     For  instance,  if  in  the 

last  half  of  the  sixth  grade  the  normal  age  is  13  years,  and  ages 

are  being  reported  on  the  half-yearly  basis,  it  will  be  found  that 

the   largest   half-yearly   group   of   children   older   than    13   is   the 

group  whose  ages  are  between  13  and  133/2-     >^imilarly,  when  the 

ages  of  children  are  found  in  years  and  months,  a  very  large  group 

of  children — often  the  largest — will  be  found  to  be  one  month, 

or   less,    above   normal    age.      The   treatment    of   these    children 

will  doubtless  be  different  from  that  of  children  who  are  nmch 

older  than  the  normal  age.     The  majority  of  them  can  probably 

be  advanced  an  extra  grade,  by  special  effort,  without  lowering 

the  standard  for  promotion.    They  would  thus  become  of  normal 

age  for  their  new  grade.     The  thought  which  I  wish  to  bring  out 

is   that   frequencies   within   the    group    "Overage    Children"    are 

greatest  near  the  normal  group,  and  that  these  are  exactly  the 

children    who    will    pro])ably    most    readily    respond    to    special 

treatment. 

The  efficiency  index  which  1  propose  in  this  connection  I 
shall  call  the  "age  rate".  It  is  the  ratio  of  the  number  of  normal 
and  younger  children  to  the  register  at  the  time  of  taking  the 
count.  You  will  see  that  it  is  again  an  application  of  our  principle 
of  expressing  the  ratio  of  actual  to  possible  conditions.    It  is  more 
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usual  to  express  the  compliment  of  this  rate,  namely,  the  rate 
of  overageness.  I  have  chosen  to  use  the  rate  of  normal  or  younger 
children,  because  the  rates  then  present  the  same  form  as  do  those 
of  attendance  and  promotion,  where,  in  all  cases,  100  per  cent 
means  perfection. 

^^'e  shall  now  inquire  into  the  relation  between  the  age-grade 
rate-  and  some  of  the  other  factors  which  we  are  considering. 
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This  chart  (Figure  VIII)  is  a  correlation  table,  the  horizontal 
scale  of  which  represents  age  rates,  and  the  vertical  scale  of  which 
represents  sizes  of  schools.  You  can  see  from  the  position  of  the 
figures  that  there  is  little,  if  any,  of  that  trend  from  upper  left 
to  lower  right,  which  would  imply  a  direct  correlation.  As  a 
matter  of  fact,  the  correlation  is  +0.03,  with  a  probable  error  of 
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0.03.  The  coefficient,  therefore,  is  not  only  very  low,  but  it  is 
no  larj>;er  than  its  probable  error.  In  this  instance,  even  more 
than  in  the  case  of  attendance  and  iJi-oniotion,  the  fact  that  a 
school  is  large,  or  medium,  or  small  has  no  bearing. 
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The  next  chart  (Figure  IX)  shows  the  relation  between  age 
rates  and  attendance  rates  in  the  474  elementary  school  organiza- 
tions at  New  York  City  for  which  age  and  attendance  figures 
were  available.  You  will  observe  that  not  only  is  the  trend 
from  upper  left  to  lower  right  absent  from  the  diagram,  l)ut 
that  there  even  appears  to  be  a  trend  from  the  upper  right  to  the 
lower  left,  indicating  an  inverse  correlation.  As  a  matter  of  fact, 
the  Pearson  coefficient  is  —0.17,  with  a  probable  error  of  0.03. 
This  inverse  correlation  may  be  surpri.sing.  It  is  true  that  it  is 
not  large;  altho  when  taken  in  relation  to  the  small  probable 
error,  it  cannot  be  neglected.  It  is  never  safe  to  argue  about 
causation  from  coefficients  of  correlation.  It  would  be  absurd 
to  suppose  that  a  high  attendance  rate  caused  overageness,  or 
that  a  large  amount  of  overageness  was  a  cause  of  high  attendance 
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rates.  However,  that  high  attendance  rates  and  low  age-grade 
rates  may  exist  together  in  the  same  schools  is  abundantly  shown 
by  this  tal)le.  It  is  probable  that  all  that  it  means  is  that  older 
pupils  attend  school   more  regularly  than  do  younger  pupils. 
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This  chart  (Figure  X)  shows  the  relation  between  age  rates  and 
promotion  rates  for  474  schools  in  New  York  last  year.  There 
is  here  a  positive  correlation  of  0.22,  with  a  probable  error  of  0.03. 
This  direct  relationship,  altho  the  r-value  is  not  large,  is  significant 
when  taken  in  connection  with  the  fact  that  it  is  more  than  seven 
times  its  probable  error.  It  is  doubtless  true  that,  in  general, 
schools  having  high  promotion  rates  show,  likewise,  good  con- 
ditions in  respect  to  the  ages  of  pupils. 
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This  chart  (Figure  XI)  shows  the  distribution  of  474  schools 
according  to  the  per  cent  of  children  at  age  or  younger.  Two 
schools  have  very  low  rates,  and  one  school  has  an  abnormally 
high  rate.  The  rest  of  the  schools  distribute  themselves  in  an 
approximately  normal  way  about  the  median,  which  is  at  66.7. 

In  all  three  of  these  indices — attendance,  promotion,  and  age 
rates — there  is  no  such  close  relationship  between  any  two  of 
them  that  one  may  be  inferred  from  another.  It  is  evident 
that  there  is  no  indirect  measurement  of  age  conditions  wlicn  pro- 
motion rates  are  known.     Likewise,  there  is  no  indirect  measure 
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Fig.  XI.     Frequency  of  Age  Rates. 


of  promotion  to  be  derived  from  attendance.  If  we  wish  to  know 
the  status  of  a  school  with  respect  to  any  of  these  facts,  we  shall 
have  to  express  each  of  them  independently.  That  is  why  they 
are  valuable  indices  of  efficiency  worthy  to  be  considered  and 
reported  separately. 

I  have  suggested,  in  the  beginning,  the  consideration,  likewise, 
of  economy  both  in  respect  to  organization  and  to  cost.  Both  these 
matters  deserve  much  fuller  treatment  than  I  can  give  them 
here.  An  index  of  the  economy  of  organization  may  be  found 
in  the  average  size  of  class,  or  ratio  of  the  number  of  pupils  to  the 
number  of  teachers  employed.  Last  year  considerable  work  was 
done  on  this  problem  at  New  York,  and  no  work  was  used  more 
effectively  in  promoting  closeness  of  organization.     Three  times 
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a  year  an  analysis  was  made  of  the  number  of  classes  of  different 
sizes,  and  of  the  number  of  pupils  enrolled  in  these  classes.  By 
this  means  the  department  was  able  to  check  up  the  number 
of  unduly  large  classes  and  to  divide  them,  and  it  was  also 
able  to  check  up  the  number  of  unduly  small  classes  and  to 
combine  them.  I  do  not  feel  that  I  ought  to  take  your  time 
in  entering  into  this  phase  of  the  question  of  economy.  I  should, 
however,  like  to  ask  your  attention  to  one  matter  which  I  con- 
sider especially  important. 

As  an  index  of  economy,  the  cost  of  instruction  per  pupil 
]ier  hour  may  ])e  used.  This  was  computed  last  year  at  New 
York  by  a  method  which  I  shall  take  a  few  minutes  to  explain 
The  cost  of  instruction  is  taken  to  include  (1)  the  cost  of  teachers' 
salaries,  and  (2)  the  cost  of  educational  supplies,  including  test- 
books,  stationery,  and  all  supplies  necessary  for  the  instruction 
of  children.  In  other  words,  I  am  excluding  the  items  of  school 
expenditure  which  do  not  vary  closely  with  the  number  of  pupils 
receiving  instruction.  I  obtained  from  each  school,  as  a  matter 
of  regular  reporting,  the  aggregate  daily  register  of  each  class. 
This  aggregate  register  was  multiplied  by  the  number  of  hours 
of  instruction  per  day  which  the  class  received.  These  aggregates 
were  combined,  for  schools  and  for  the  entire  city,  thus  furnishing 
the  aggregate  number  of  hours  of  instruction  which  the  ele- 
mentary schools  of  the  city  gave  to  pupils  during  the  school  year. 
This  aggregate  reached  the  enormous  total  of  617,767,110.  Ob- 
serve that  altho  I  call  these  the  aggregate  hours  of  instruction, 
they  are  really  the  aggregate  hours  of  register.  In  other  words, 
I  am  using  the  register  rather  than  the  attendance  as  the  basis 
for  computing  cost. 

A  few  words  may  not  be  amiss  as  to  the  propriety  of  using 
the  register  rather  than  the  attendance  of  pupils  as  the  basis 
for  computing  the  unit  cost  of  instruction.  In  the  first  place, 
expenditures  for  teachers'  salaries  are  adjusted  to  register  rather 
than  to  attendance.  The  number  of  teachers  required  in  any 
given  school  is  determined  on  the  basis  of  register  rather  than  of 
attendance.  Requests  for  increase  and  decrease  of  classes  are 
supported  by  evidence  as  to  the  registers  of  classes.  The  creation 
of  special  classes  and  of  classes  for  defective  children  is  again  based 
upon  the  number  of  children  who  will  belong  to  the  classes,  rather 
than  upon  an  attempt  to  determine  those  who  will  actually 
attend  them.  Of  course,  the  number  of  attendants  is  considered 
to  be  a  rough  aj^proximation  of  the  number  belonging,  but,  so 
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far  us  the  two  numbers  differ,  it  is  the  latter  rather  than  the  foi-nier 
which  (h^terniines  the  need  for  the  class. 

In  tlie  second  ])lace,  ex])enditures  for  text])0()ks  and  sujij^lies, 
wherever  tlu^se  are  furnished  by  the  board  of  education,  are 
l)ased  upon  register.  Allotments  of  money  for  the  ensuing  year, 
are  made  to  ]:)rinci])als  of  schools,  on  the  Ijasis  of  the  number 
of  children  belonging  to  the  school,  i.e.  upon  the  register,  and  not 
upon  the  attendance.  If  a  principal  makes  application  for  an  addi- 
tional a]ipro])riation,  th(>  supporting  data  are  again  those  of 
register;  lie  shows  an  increase  in  the  number  of  children  who 
Ix^long  to  his  school,  over  the  lunnber  upon  which  the  original 
ajijiropriation  was  based. 

It  has  Ix'cn  argued  that  the  estimate  of  instruction,  when 
l;ased  u]ion  attentlance,  constitutes  "solid  sei'\ice".  Tiie  argu- 
ment respecting  "solid  service"  is  a  fallacy  drawn,  in  all  ])rob- 
ability,  from  ihv  industries,  where,  in  a  different  sense,  it  plays 
an  in  portant  part.  The  analogy,  however,  does  not  apply  to 
the  schools.  The  attendance  or  absence  of  em])loyees  in  a  factory 
is  indeed  determinative  of  output,  and  the  cost  per  operative 
must  sur(dy  h^ave  out  of  account  the  operatives  who  are  absent. 
This  might,  indeed,  furnish  an  analogy  for  application  to  teachers, 
but  it  can  form  no  proper  combination  as  applied  to  pupils. 
They  are  not  em])loyees,  nor  do  considerations  applicable  to  ein- 
ploye(  s  apply  to  tliem.  If  we  must  use  factory  terms  in  our  educa- 
tional vocabulary,  we  may  say  that  the  pupils  represent  the  raw 
material,  and  that  the  product  is  the  refinement  of  this  material. 
And  the  peculiarity  about  the  raw  matorial  is  that  whether  it  is 
j)hysically  pres(  nt  or  alisent,  i1  is  always  jiresent  in  the  sense 
that  it  always  belongs  to  the  work  of  the  school,  and  that  it  is 
always  to  be  refined. 

The  service  which  is  based  upon  attendance  is  indeed  "solid", 
but  it  is  only  a  fraction  of  the  total  instructional  service  rendered. 
Far  the  greater  part  of  the  aggregate  absence  of  ])upils  is  an 
accumulation  of  many  short  ])erio(ls  of  absence,  due  to  temporary 
causes.  There  is  in  most  cities,  and  there  ought  to  be  in  all  of 
tlieni,  ])rovision  for  the  discharge^  from  the  register  of  pupils 
who  ai-e  required,  for  proper  reasons,  to  be  absent  for  longer 
than  a  prescribed  ])eriod.  Pupils  who  are  absent  for  insufficient 
reasons  are  being  reached  mor(>  and  more  effectively  every  year, 
thru  the  compulsory  education  service.  What  justification,  there- 
fore, that  there  might  have  been  in  the  past  for  basing  instruction 
ui)on  attendance-  a  justification  due  to  the  fact  that  the  register 
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was  a  \aiialili'  (iiiantity — appcai-s  to  he  hccoininji;  of  less  forrc 
as  tlic  >ch()(il  liusinoss  bocoiiics  iikhc  (Icfiiiitcly  orjiaiii/.cd  ami 
school  laws  tx'coiiic  iiioi'c  ail('(|iialcl\'  enforced. 

Tlie  estimate  of  tlie  amount  of  instruction,  as  l)ase<l  upon 
attendance,  has.  1  l)elie\-e,  heen  foisted  upon  the  educational 
Avoild  t)\-  Wusiness  men  who  failed  t(»  make  the  j)r()i)er  distinction 
lietweiii  cost  accounting  in  l)usine«  and  cost  accountinsj;  in 
(ducation.  No  school  man  would  conduct  an  (ducatioiial  system 
on  aii>'  other  basis  than  that  the  teachers  are  responsible  for  the 
instruction  of  all  pupils  belonging  to  their  classes.  Promotion 
rat(s  are  based  upon  the  ratio  of  ])U]m1s  advanced  to  ])ii])ils  on 
regist(  r.  The  number  in  attendance  is  disi-egarded.  The  instruc- 
tion is  for  all.  and  the  sei'vice  is  I'endei'cil  to  all.  Textbooks  and 
supplies — an  important  element  in  cost  of  instruction  are  like- 
wise issued,  in  general,  to  all  i)U])ils  who  are  registered.  Each 
child  has  his  own  textbooks  and  material.  If  he  is  absent,  he  either 
has  his  books  at  hoiiM',  or  they  are  left  at  the  school.  In  either 
case,  it  is  not  ]iracticable  to  issue  them  to  another  pui)il.  The 
loss,  damage,  and  waste  incident  to  a  di\ided  responsibility  for 
them  could  not  be  justified. 

l'"inall,\\  the  service  based  ui)on  attendance  is  not  "solid" 
even  in  the  sense  in  whiidi  those  who  use  it  appear  to  think  it 
is.  The  reporting  of  attendance  is,  in  all  localities  with  which 
I  am  familiar,  based  upon  the  assumption  that  a  child  present 
part  of  the  day  is  to  be  i'e])oi-1ed  as  in  attendance  for  that  day. 
Thus  the  basing  of  cost  upon  attendance  admits  a  margin  of 
en-oi-.  <lue  to  the  iact  that  thousands  of  children  every  day  attend 
school  only  a  portion  of  the  time  devoted  to  instruction  for  their 
classes.  A  great  many  attend  in  the  morning  Avho  are  absent 
in  the  afternoon.  Others  are  ])resent  in  the  afternoon  and  not 
present  in  the  morning.  Still  others  are  excused  during  either 
the  morning  or  the  afternoon  session.  The  minute  we  try  to 
base  cost  U])on  attendance,  we  ai'e  coid"ronted  by  such  jierplexing 
})r()blen)s  as  these.  l''oi'  legal  purjjoses,  fractions  of  days  may  be 
counted  as  whole  da\s;  but  if  we  are  to  estimate  the  amount  of 
"solid  ser\ice"  as  based  upon  attendance,  we  shall  be  obliged 
to  introduce  I'cfinemeids  of  i-e])orting  attendance  which  would 
be  burdensome  and  inti-icate.  There  can.  howcx'er,  be  no  doubt 
as  to  the  length  of  time  dui'ing  which  it  is  pi'opei'  to  say  that  a 
child  belongs  to  the  school,  that  is,  there  can  be  no  doubt  as  to 
the  number  of  days  that  he  is  on  the  register. 

I    ctmnol    give    \-ou    the    cost    of   instruction    per    pupil    hour 
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on  this  l)asis  for  any  other  city  than  Now  York.  T1h>  foUowins 
facts,  how(n'('r,  were  true  for  that  cit.y  for  tlic  school  year  11)14- 
15:  For  elementary  schools,  exclusive  of  kindergartens,  the 
aggregate  hours  of  register  were,  in  round  numbers,  618, 000, ()()(); 
the  cost  of  the  salaries  of  principals  and  teachers  was  $23,500,000; 
and  the  cost  of  supplies  SI, 390, 000,  giving  a  total  cost  of  instruc- 
tion, defined  as  above,  of  a  trifle  less  than  $25,000,000.  On  these 
bases,  the  cost  of  salaries  for  each  hour  a  pupil  was  registered  was 
$.038;  the  cost  of  educational  supplies  was  $.00234;  making  the 
instructional  cost  almost  exactly  $.04.  For  kindergart(>ns,  the 
aggrc'gate  hours  of  register  were  more  than  18,000,000,  and  the 
cost  of  i  list  i-uction  (salaries  and  supplies)  was  a  little  less  than 
$1,000,000.  .\ccordingly,  the  cost  of  instruction  was  $.053  per 
pupil  per  houi-  for  kindergartens.  For  elementary  schools, 
including  kindergartens,  the  cost  of  salaries  was  $.0383;  the  cost 
of  su])i)lies  was  $.002^4;  and  the  cost  of  instruction  $.0405. 

The  cost  of  instruction  per  pupil  per  hour,  in  elementary 
schools  at  New  York,  has  also  Ix'cn  c()nii)uted  on  the  l)asis  of 
attendance.  It  is  interesting  to  note  the  difference  between 
this  cost  and  similar  cost  on  the  l)asis  of  register.  In  the  Annual 
Financial  and  Statistical  Report  of  the  i^ureau  of  Audit  and 
Accounts  for  tlie  New  York  D{>partment  of  Education,  the  cost 
per  pupil  per  hour  is  given  for  1014,  on  the  basis  of  attendance, 
as  $.04564.  That  is  to  say,  the  cost  on  register  is  almost  exactly 
4  cents  an  hour  for  each  pupil,  while  that  on  attendance  is  more 
than  43-2  cents.  This  difference  of  Yi  a  cent  per  pupil  hour,  it  is 
maintained,  rein'esents  a  true  statement  of  the  cost  of  extension 
of  educational  service  to  pupils  belonging  to  the  schools  during 
such  time  as  they  are  not  in  attendance.  It  is  precisely  our 
contention  that  the  service  is,  in  fact,  extended  to  such  pupils, 
and  that,  accordingly,  the  cost  of  instruction  for  each  pupil  during 
every  hour  that  he  is  a  member  of  a  school  is  properly  the  figure 
to  be  used  and  reported. 


A  Survey  of  the  Gary  Schools  and  the  Pre- 
Vocational  Schools  in  New  York  City 
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During  the  school  year  1914-15  Superintendent  Wirt  of  Gary, 
Ind.,  was  retained  by  the  Board  of  Estimate  of  New  York  City, 
and  he  organized  during  that  year  two  schools  on  the  Work- 
Study-and-Play  plan.  During  the  same  year,  there  were  organized 
]3y  Associate  Superintendent  Ettinger  of  New  York  City  six 
schools  wdth  a  pre-vocational  course  of  study.  This  course  of 
study  affected  only  the  seventh  and  eighth  grades. 

City  Superintendent  Maxwell  asked  me  to  make  a  study  of 
these  two  types  of  experimental  schools  with  a  view  of  ascertain- 
ing the  success  which  they  had  in  the  instruction  of  their  students 
in  some  of  the  regular  academic  subjects.  It  was  his  thought, 
and  it  is  also  mine,  that  no  matter  how  people  may  differ  as  to 
their  educational  creeds,  no  matter  how  they  may  vary  in  their 
conception  of  how  the  elementary  schools  should  be  organized, 
no  matter  how  wide  a  variation  there  may  be  in  courses  of  study, 
there  are,  nevertheless,  some  subjects  so  fundamental,  and  there 
are  some  parts  of  these  subjects  so  fundamental  that  ignorance 
of  them  is  a  misfortune,  and  instruction  in  them  is  an  imperative 
necessity.  The  State,  in  extending  universal  education  to  the 
children  of  its  citizens  contemplates  that  they  shall  be  informed 
concerning  some  fundamental  matters,  and  whether  the  organ- 
ization of  the  school  be  called  by  one  name  or  another,  Ave  cannot 
regard  an  organization  as  successful  unless  it  offers  sufficient 
instruction  in  these  fundamentals. 

The  report  which  I  gave  you  yesterday  was  a  by-product 
of  this  survey  of  the  experimental  schools  in  the  City  of  New 
York.  As  you  will  remember,  the  subjects  in  Avhich  the  children 
were  tested  were  arithmetic,  spelling,  geography,  history,  and 
English  grammar — all  applied  to  the  seventh  and  eighth  grades. 
I  may  state  general  conclusions  at  the  outset.  The  regular 
schools  showed  the  greatest  amount  of  improvement.  The  pre- 
vocational  schools  were  next,  and  the  Gary  schools  were  last. 
This  is  a  statement  drawn  from  an  enormous  amount  of  detail. 
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It  is  only  true  as  a  sf'nci'al  statement.     There  were  many  details 
in  which  the  orchn-  of  improvement  was  not  as  I  have  stat(Hl  it. 

These  tests  were  (lesi,i>;ae(l  to  be  tests  of  eciual  (lifH('ult>',  and 
no  small  (>ffort  was  ex])ended  to  make  them  so.  (Question  1  of  the 
March  test,  say  in  arithmetic,  was,  by  a  eonsideral)l(>  amount  of 
tcstini;  cari'ied  on  thi'uout  the  counti\\-.  determined  lo  be  of 
ecjual  (hdiculty  witii  (luestion  1  of  the  June  test;  and  (iu(>stion 
2  of  the  March  test  was  likewise  a  i)ai'allel  (luestion  in  ])()int  of 
dilhcuity  with  ([uestion  2  of  the  June  test;  and  so  on  foi-  the 
entire  series.  Since  the  elements  composinii;  the  test  were  each 
(■(pial  in  point  of  difficulty  to  a  corresi)ondin,ii  element  in  tlu>  second 
test,  the  tests  t  lieniselv(>s  as  total  instruments  of  ineasurenieiit 
mij>;ht  h<'  said  to  l)e  of  equal  difficulty.  The  ;ictu;il  (juestions  are 
the  ones   I   (hstributed  to  you  yi'stei(hi.\    moiiiinti. 

First,  the  improvement  in  arithmetic,  a^  measui'e(l  by  the 
])er  cent  of  pupils  who  did  better  in  June  than  they  did  in  Mai'ch, 
was  as  follows:  For  the  Gary  schools,  40.7  per  cent;  for  the  pre- 
vocational  schools,  47.0  ])er  cent;  and  for  the  retiular  schools, 
54.3  per  cent.  The  rank  of  the  different  types  of  schools,  there- 
fore, was:  reiiular  schools  first,  pre-vocational  schools  second,  and 
( \iiv\  schools  t  bird. 

Second,  in  s])ellinj>;  the  i)r()porti()n  of  children  who  did  better 
in  the  June  test  than  in  the  March  t(>st  was  as  follows:  In  the  (lary 
schools,  .")2.<S  ])er  cent;  in  the  ])re-vocati()nal  schools,  0)!.7  pel'  cent  ; 
and  in  the  i'e.<i,ular  schools,  03.0  per  cent.  You  will  see,  therefore, 
that  the  sei'ial  ordei-  was  i)re-v()cational  schools  first,  rei^ular 
schools  second,  and  (lary  schools  third,      a  rather  ])ooi'  third. 

Third,  in  «>;e()}>;rai)h>',  by  \\\v  same  system  of  ])arallel  testin«!;, 
the  jji'oportion  of  children  who  showed  imi)rovement  in  June 
was:  For  the  (iary  school,  58  ])er  cent;  for  the  i)re-vocational 
schools,  53.4  per  cent;  and  for  the  re<>;ular  schools,  57.7  per  cent. 
The  serial  order  was:  first  the  (Jary  schools,  second  the  regular 
schools,  and  third  the  jire-vocational  schools. 

P'ourth,  in  history  the  ])ercentages  of  imj^rovement  were  as 
follows:  For  tlie  Gary  schools  72.3,  for  the  pre-vocational  schools 
07.2,  and  for  the  regular  schools  03.2.  The  order,  therefore,  was: 
Gary  schools  first,  pre-vocational  schools  second,  and  regular 
schools  third. 

Finally,  in  English  grammar  the  improvement  was:  ¥ov  the 
Gary  schools  58.8  per  cent  of  the  pui)ils,  for  the  pre-vocational 
schools  05.8  per  cent,  and  for  the  regular  schools  02.9  per  cent. 
The  serial  order,  ther(4'ore,  was:  Pre-vocational  schools  first,  regu- 
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lur  schools  second,  and  Gary  schools  third.  The  Gary  schools,  on 
this  basis  of  showing  improvement,  W(>re  third  in  arithmetic, 
tliird  in  spelling,  first  in  geography,  first  in  history,  and  third  in 
English  grammar.  What  I  have  just  given  you,  bear  in  mind, 
is  the  proportion  of  children  who  showed  improvement. 

I  have  also  estimated  the  improvement  on  the  basis  of  the 
difference  between  the  number  of  questions  answered  correctly 
in  March  and  in  June.  If  it  is  thought  that  the  first  basis  for 
estimating  improvement  is  objectionable,  it  will  Ije  tliought  so 
on  the  ground,  in  the  main,  that  a  child  may  show  very  large 
improvement  and  there  will  be  no  more  credit  indicated  than  there 
would  be  for  a  child  whose  improvement  was  very  small — that 
they  are  all  counted,  if  they  showed  any  improvement,  simply 
as  being  so  many  children  who  improved.  But  for  large  numbers 
of  children,  those  of  you  who  are  familiar  with  the  behavior 
of  figures  drawn  from  abundant  sources,  will  realize  that,  while 
this  is  a  discrepancy  which  might  come  out  for  small  groups  of 
people,  it  would  not  when  large  groups  were  concerned;  and  this 
is  borne  out,  in  this  study,  by  the  fact  that  when  improvement 
is  shown  on  the  basis  of  the  difference  between  the  number  of  ques- 
tions answered  correctly  in  March  and  in  June,  there  is  no  change 
for  any  subject  in  the  ranking  of  the  three  types  of  schools.  On 
the  second  basis  of  improvement,  if,  in  the  Gary  schools,  on  the 
average,  ■i]/2  questions  had  been  answered  correctly  by  each 
child  in  March,  and  if  in  the  parallel  test  in  June  five  questions, 
on  the  average,  were  answered  correctly,  then  the  improvement 
would  be  half  a  question.  As  I  say,  on  this  basis  there  is  no  difter- 
ence  in  th(>  character  of  the  showing. 

Thirdly,  I  showed  the  improvement  on  the  basis  of  the  relation 
between  the  actual  and  the  possible  improvement.  In  any  given 
class,  if  one  child  is  rated  40  per  cent  and  another  is  rated  80  \)vv 
cent,  and  if  the  improvement  of  each  child  is  10  per  cent,  making 
one  of  them  50  and  the  other  90,  we  are  likely  to  feel  that  this  is 
not  to  be  interpreted  as  meaning  that  they  both  improved  to  the 
same  extent.  It  is  much  harder  for  the  child  who  is  already  80 
per  cent  to  improve  at  all.  The  possibility  of  ini])rovement  is 
very  mucli  diminished. 

Now,  the  child  who  was  at  40  per  cent  and  who  added  10  per 
cent  to  his  rating,  would  improve  only  one-sixth  of  his  possible 
improvement,  that  is,  one-sixth  of  the  distance  from  40  per  cent 
to  100  per  cent.  His  increase  of  10  ])er  cent  would,  therefore, 
mean  16%  per  cent  of  his  possible  improvement.     On  the  other 
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hand,  the  child  who  began  at  80  and  advanccHl  to  90  woukl  im- 
l^rove  10  ])er  cent  where  it  was  possible  to  improve^  20  per  cent. 
His  increase,  therefore,  in  relation  to  his  ])()ssil)le  increase  would 
be  one-half  or  50  per  cent. 

I  calculated  tlu^  improvement  for  the  (liffereiit  types  of  scliools 
on  this  basis,  and  there  was  sul)stantially  no  chanf^e  except  for 
the  fact  that  the  showing  was  somewhat  more  favorable  to  the 
r(>gular  schools,  due  to  the  fact  that  their  ratings  were,  in  general, 
liighei-  to  begin  with.  Accordingly,  tlieii'  imi)rovement  from  the; 
higlu>r  initial  ratings  counted  more  wlieu  one  took  it  in  relation 
to  what  their  improvement  could  have  been.  The  serial  order  for 
each  of  the  subjects  was  only  changed  in  the  case  of  geography, 
where  instead  of  the  Gary  schools  being  first  by  a  small  amomit, 
the  regular  schools  Avere  first  by  a  small  amount. 

When  I  sought  an  answer  to  the  general  (luestion  as  to  which 
type  of  school  showed  greatest,  next  greatest,  and  least  improvement 
I  first  combined  tlu^  scores  for  each  of  the  subjects  into  one  general 
score  for  all  subjects  taken  together.  The  result  was,  as  I  said 
in  the  beginning,  that  the  regular  schools  were  first,  the  ])re- 
vocational  schools  second,  and  the  CJary  schools  third,  \^y  the 
first  method  (per  cent  of  ciiildreii  who  impi'ovecl)  the  ranking 
was  indicat(Ml  by  tlu^  figures  (iO,  5932)  '*'!<'  •">*'•  ^^y  t'"'  second 
method  (difference  between  initial  and  final  scores)  the  ranking 
was  indicated  by  the  figures  7.5.  7.^^),  and  5.(i,  By  the  third 
method  (ratio  of  actual  to  possible  improvement)  the  figures  were 
14.4,  \'A:S,  and  9.7. 

In  the  statements  I  have  just  made  the  assum|)tion  has  been 
that  one  subject  is  (Mjual  to  anotluM'.  Now,  we  all  know  that 
this  isn't  true.  No  one  would  sui:)i)ose  that  spelling  was  as 
im])ortant  as  arithmetic,  not  but  that  it  may  be  socially'  as 
important — that  isn't  what  I  mean — but  elementary  schools  don't 
spend  as  much  time  on  it;  it  doesn't  bulk  as  large  in  the  total 
activity  of  the  school  as  does  arithmetic.  Similarly,  English 
grammar  is  of  relatively  less  importance,  on  the  basis  of  the 
time  cost  in  the  curriculum,  than  geography.  ^Accordingly,  I 
weighted  these  subjects,  taking  account  of  the  time  spent  in  the 
study  of  each  of  them  in  the  elementary  schools.  This  had  the 
effect  of  giving  considerably  more  advantage  to  the  regular 
schools  than  was  given  to  them  when  each  subject  was  counted 
as  of  equal  importance.  This  was  due  to  the  fact  that  the  one 
subject  of  the  five  to  which  the  greatest  amount  of  school  time  is 
devoted,    namely,    arithmetic,    is    exactly    the    subject   in    which 
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the  roo-ular  schools  showed  the  greatest  amount  of  superiority 
over  the  other  two  types.  But  upon  any  showing,  whether  it 
is  the  per  eent  of  ehihlren  who  improve,  or  tiie  difference  betAveen 
the  number  of  questions  they  answered  correctly,  or  the  ratio  of 
the  actual  to  the  possible  improvement,  or  whether  it  be  with 
subjects  counted  as  of  equal  weight,  or  with  subjects  counted  as 
weighted  by  the  time  spent  upon  them — in  all  cases,  when  the 
matter  is  boiled  down  to  a  general  statement,  the  order  of  im- 
provement is  invariably  the  same. 

Now,  the  method  that  I  have  followed  in  this  report  has  been 
vigorously  attacked.  I  haven't  answered  any  of  the  criticisms, 
and  I  have  no  pr(\sent  intention  of  doing  so.  If  it  should  come 
to  the  point  where  persons  competent  to  judge  an  inquiry  of  this 
kind  and  willing  to  assume  a  reasonably  detached  point  of  view 
questioned  the  workmanship  or  pointed  out  instances  where  the 
interpretation  of  the  data  was  erroneous  or  misleading,  I  might 
have  something  to  say.  Meanwhile,  however,  you  should  realize 
that  in  order  to  make  the  report  understood  by  those  for  whom 
it  was  intended,  it  was  necessary  for  me  to  avoid  Ijeing  lost  in  the 
great  detail  out  of  which  the  general  conclusions  arose.  Anyone 
who  wants  to  make  a  case  wants  the  tletails,  and  a  person  can 
make  out  almost  any  kind  of  a  case  he  likes  from  the  details  if 
he  confines  himself,  either  exclusively  or  generally,  to  those  details 
that  help  the  cause  he  wants  to  advocate. 

If  he  is  a  bungler  he  will  confine  himself  to  such  details  ex- 
clusively; if  he  is  artful  he  will  include  enough  details  of  the 
o])])osite  kind  to  give  himself  the  appearance  of  candor.  I  have 
seen  some  very  curious  statements  drawn  from  my  own  report, 
statements  that  are  quite  erroneous;  and  as  long  as  they  are, 
I  feel  quite  sure  that  I  can  leave  to  competent  people  a 
judgment  between  the  critics  and  myself. 

It  is  true  that  the  Gary  schools  had  not  been  long  organized, 
and  it  would  have  been  outrageous  if  I  had  given  them  one  test 
and  drawn  any  conclusions  from  it,  but  I  gave  them  two,  and 
I  drew  no  inference  whatever  from  the  first  test,  but  only  from 
the  difference  which  was  shown  as  between  the  first  and  the 
second.  Now  if  the  Gary  schools  in  process  of  reorganization 
were  discriminated  against  in  the  first  test,  it  would  be  supi)osed 
that  their  situation  three  months  later  would  be  very  much 
improved.  They  would  be  like  a  person  who,  due  to  some  physical 
illness  of  the  moment,  performs  below  form,  and  then  at  a  later 
time  on  a  similar  test,  say  of  strength  or  intellectual  ability,  shows 
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a  marked  iinprovc^nunit.  That  is  the  situation  in  whicli  it  sccins 
to  inc  tlic  newly  orii;aniz(Ml  schools  were.  ^I'hc  \crv  I'act  that 
they  were  in  a  (lisa(lvantaj2;('ovis  coiulition  at  the  time  of  the 
first  test  would  ojierate  to  give  tlieni  an  unusual  opport  unit  >• 
to  show  ini])roveinent  between  that  and  the  second  test. 

If  it  is  objected  tiiat  the  (lary  schools  were  not  really  (iary 
schools  and  that  conclusions  about  them  should  not  be  used 
as  conclusions  about  the  (lary  syst(Mn,  I  shall  re])ly  that  1  have 
nowhere  applied  them  to  the  Gary  system.  The  conclusions  are 
true  and  valid  for  the  schools  investisat(Ml.  What  a])])licati()n 
others  nuiy  <>;ive  them  on  the  basis  of  the  schools  bein<>;  typical 
will  be  for  them  to  justify.  The  foUowinji  citation  from  the  re- 
])or,  will  indicate  my  own  attitude:* 

"In  all  fairness  some  caution  should  be  exercised  in  (h'aw- 
ing-  from  the  data  of  this  re])ort  iid'erences  unfavorable  to 
the  (iar>-  schools.  We  may  ])roperly  remind  ours(>lves  that  their 
educational  ])hilosophy  is  not  that  of  the  traditional  sciiools, 
and  that  it  is  truer  and  more  vital  than  any  ])hilos()phy  which  tiie 
traditional  sciiools  usually  i)ut  into  practice.  We  ought  also  to 
remember  that  we  are  comparing  two  types  of  schools  as  to 
matters  which  one  of  them  emphasizc^s  and  which  the  other  does 
not.  .  .  .  The  modern  social  phil()S])()hy,  the  ])hilosophy  of 
John  Dewey  and  his  school,  is  too  profoundly  true  to  be  belittled 
by  any  one.  In  so  far  as  Superintendent  Wirt  is  actuated  by  that 
])hiloso])hy  he  should  V)e  given  profoundly  respectful  attention. 
It  ajjjx'ars  not  only  that  he  is  so  actuat(Ml.  but  that  he  is  one  of  the 
few  jx'rsons  who  liave  consciously  and  systematically  attem])1ed 
to  woi'k  ()\-er  his  theories  into  practice.  Ojiinions  as  to  his  success 
in  this  most  difficult  task  of  translating  theory  into  ])ractice  will 
vary  between  the  o])inions  of  those  who  blindly  accept  and  seek 
to  transplant  them,  and  the  o])iirK)ns  of  those  who,  with  ecpial 
blindness,  reject  them  entirely. 

"Meanwhile,  however,  it  is  entirelx'  proper  to  s(>ek  to  a])])raise 
the  work  of  the  schools  conducted  on  the  (iary  ])lan.  Su])er- 
intendent  Wirt  has  never  objected  to  this.  In  fact,  he  has  wel- 
comed every  attempt  to  survey  i\w  schools  at  Gary  and  is  now 
planning  to  cooperate  with  the  General  Education  Board  for  a 
systematic  investigation  of  them.  To  accuse  any  one,  therefore, 
of  lack  of  syni])athy  with  the  Gary  plan  because  he  seeks  to 
evaluate  it,  is  to  accuse  Superintendent  Wirt  himself. 
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"If,  then,  we  wish  to  appraise  the  work  of  the  Oary  schools 
we  must  suspend  judgment  concerning  them  until  the  api)raisal 
has  been  made.  We  must  give  them  abundant  opportunity  to 
justify  themselves,  and  we  must  give  them  an  attentive,  sym- 
])athetic  hearing.  We  must  lie  judges  and  not  partisans;  neither 
so  radical  that  the  lessons  of  the  past  m(>an  nothing  to  us,  nor 
so  conservative  that  our  faces  are  not  turned  toward  the  light. 
In  maintaining  the  judicial  attitude  we  should  insist  that  the 
Gary  plan  be  set  up  only  so  far  as  favorable  exi)erimental  condi- 
tions require.  The  evidence  afforded  by  this  report  is  unfavorable 
to  the  defendant.  It  shows  that  claims  made  have  not,  in  these 
particular  schools,  been  substantiated.  It  makes  clear  that  in 
matters  regarded  by  the  State  as  constituting  essential  parts  of 
an  elementary  education,  these  schools  have  been  unable  to 
advance  as  many  of  their  pupils  within  a  given  time  as  have  the 
schools  offering  the  regular  course  of  study." 


Cost  of  Instruction  in  Indiana   High  Schools, 
and  Related  Topics 


IlunKUT  (1.   Ciiii.DS,   Associate  I'l-ofcssor  ol'  Sccondan-    Kdiication,    hidiatii. 

Univ(srsity 

Until  r(>('eiitly  very  little  has  been  done  in  th(>  administrjition 
of  American  sciiool  systems  but  to  follow  the  lines  of  tradition 
and  opinion,  and  some  still  work  on  (liis  basis,  as  attested  by 
a  ([uestionnaire  received  recently  from  the  superintendent  of  one 
of  our  lars*'  eastern  school  systems,  who  wished  to  ascertain 
llie  opinions  of  superintendents  and  colle<i;e  pi'ofessors  regarding 
their  estinuite  of  the  value  of  certain  school  methods.  In  rei)ly 
an  exi)ression  of  o])inion  was  given  with  this  addition:  "Why 
do  >()U  asi<.  the  opinions  of  superintendents  and  professors  who 
know  no  more  about  it  than  you  do?  You  have  HO, 000  or  40,000 
children  in  yoiu'  schools.  Why  not  select  twenty  or  thirty  teachers 
in  the  gr;ides  in  (piestion,  divide  them  into  two  ecpiivalent  groups, 
and  luive  each  group  try  out  one  of  the  two  methods  for  a  year, 
collect  and  tabulate  data,  and  determine  your  future  nu'thod 
])y  the  findings?" 

The  Anu'rican  public  high  school  has  developed  so  ra])idly 
in  the  i)ast  (piarter  of  a  century  and  has  taken  siu-h  hold  upon 
l)o])ui;ir  imagination  that  it  has  l)een  ])ossil)le  f(jr  the  supei'in- 
tendents  to  ask  for  almost  anything  in  the  way  of  financial 
assistance  and  get  it.  The  great  increase  in  attendance  and 
teaching  staff  and  the  increasing  cost  and  vafiety  of  studies  and 
of  equipment  have  well-nigh  brought  us  to  the  limit  of  our  re- 
sources. It  has  now  reached  a  point  wherc^  the  superintendent 
or  i)rincii)al  who  wishes  to  develop  a  new  and  important  addition 
to  his  high  school  activities  must  be  able  to  effect  economies 
in  his  present  practice,  arid  to  do  this  he  must  have  definite 
standards  of  organization  as  a  basis  for  convincing  argument. 
More  and  more  the  school  administrator  is  becoming  an  educa- 
tional and  business  expert.  Fifteen  years  ago  no  superintendent 
knew  what  per  cent  of  his  pupils  were  accelerated,  normal,  or 
retarded,  but  five  or  six  years  of  careful  investigation  of  the 
problem  has  made  this  one  of  the  standard  items  of  school  adminis- 
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tration,  and  has  had  wide  influence  in  establishinji;  departmental 
work  and  in  breaking  down  the  lockstep  in  educational  advance- 
ment, and  incidentally  in  reducing  the  cost  of  repeaters.  Ten 
years  ago  scarcely  a  superintendent  could  tell  the  cost  per  capita 
for  instruction  in  the  elementary  or  high  school. 

In  1912  Superintendent  Spaulding,  of  Newton,  Mass.,  did 
inoneer  work  in  determining  the  cost  of  instruction  in  the  different 
high  school  subjects  in  each  of  his  three  high  schools,  for  the 
purpose  of  reorganizing  his  courses  and  administrative  procedure. 
Two  years  ago  one  of  my  graduate  students  worked  out  a  master's 
thesis  on  this  problem  in  the  high  school  at  South  Bend,  and  within 
a  year  two  other  valuable  contributions  have  been  published  on 
this  subject:  "High  School  Costs",  by  Dr.  J.  F.  Bobbitt,  of 
Chicago  University,  in  the  "School  Review"  for  October,  1915, 
and  "Cost  of  Instruction  in  Kansas  High  Schools",  by  Professor 
W.  S.  Monroe  of  the  State  Normal  School,  Emporia,  Kan. 

The  topic  on  which  I  am  to  report  today  was  planned  with  the 
committee  of  research  of  the  State  High  School  Principals' 
Association  at  the  time  of  our  conference  one  year  ago. 

In  November,  1915,  notice  was  sent  to  the  principal  of  every 
commissioned  high  school  in  Indiana  that  such  a  study  was  to 
be  made  and  that  all  the  school  had  to  do  if  it  wished  to  cooperate 
was  to  send  for  the  blank  forms,  fill  them  in,  and  return  them 
to  my  office.  Thirty-four  schools  have  returned  the  data  in- 
dicated on  this  form. 
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While  this  investigation  had  for  its  purpose  the  study  of  costs 
of  instruction  in  different  high  school  subjects  under  comparable 
conditions,  the  complete  report  will  show  the  following  sub- 
ordinate topics: 

1.  Average  salaries  of  teachers. 

2.  Average  size  of  classes. 

3.  Number  of  large  and  small  classes    by  schools,   groups, 

and  departments. 
•1.  Average  number  of  teaching  periods  a  week  per  teacher, 

5.  Average  number  of  60-minute  teaching  hours  a  week  per 

teacher. 

6.  Number  pupil  hours  per  week  per  teacher, 

7.  Number  and  per  cent  of  teachers  teaching  each  number 

of  subjects  from  one  to  four  or  more. 

8.  Number  of  pupil  enrollments  per  teacher. 

9.  Per  cent  the  study  hall  cost  is  of  instructional  cost. 

10.  The  per  cent  the  credits  attempted  in  each  department 
are  of  all  credits  attempted. 

The  data  from  the  teacher  schedules  for  each  school  were 
assembled  under  the  following  form  and  from  these,  similar  items 
were  taken  to  make  up  the  various  comparative  tables  of  this 
report. 
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In  passing  to  a  more  detailed  description  of  cost  factors,  I 
wish  to  indicate  in  a  preliminary  way  certain  factors  that  have 
been  taken  into  account  in  determining  the  time  and  salary  to 
include  in  making  up  this  report.  In  case  of  the  salaries  of  super- 
intendents or  principals  who  teach  part  time,  it  seemed  un- 
reasonable to  count  the  proper  fractional  salary  against  teaching 
account  as  this  higher  salary  was  paid  for  executive  and  not  for 
teaching  al)ility.  For  this  report  the  next  even  $100  above  that 
of  the  highest  paid  regular  teacher  in  the  school  was  taken  as  the 
salary  for  the  superintendent  or  principal,  and  then  the  pro- 
portional part,  as  determined  by  his  time  of  teaching,  was  charged 
against  instruction.  In  estimating  the  teacher's  weekly  time, 
time  regularly  given  to  assembly  and  study  hall  duties  has  been 
included  in  the  instructional  account,  and  such  study  hall  cost 
has  been  distributed  among  the  departments  requiring  study  work 
in  proportion  to  the  number  of  credits  attempted  in  these  depart- 
ments to  obtain  the  cost  per  credit  or  in  proportion  to  the  number 
of  pupil  hours  of  work  to  obtain  the  cost  per  pupil  hour.  It  seems 
to  the  writer  that  study  hall  supervision  is  a  legitimate  charge 
against  the  instructional  account  of  the  school,  but  it  should  not 
be  charged  against  the  department  which  a  given  teacher  rep- 
resents, for  a  teacher  may  be  giving  time  to  study  hall  out  of 
all  proportion  to  the  needs  of  his  department,  as  in  the  case 
of  a  manual  training  teacher  who  teaches  his  subject  one-half 
day  and  is  in  charge  of  study  assembly  one-half  day.  His  is  a 
non-study  subject  and  should  have  no  study  hall  charges  made 
against  it. 

In  a  few  cases  extra-class  time  has  been  checked  on  the  reports, 
as  for  regular  coaching  of  athletics  or  debate,  where  it  was  evident 
that  this  was  a  regular  feature  of  the  teacher's  work  and  was 
considered  in  his  schedule  of  hours  or  salary. 

The  time  of  this  extra-class  work  is  included  in  making  up 
the  teacher's  weekly  time,  but  the  cost  has  not  been  entered 
because  in  the  absence  of  credit  or  definite  indication  of  the 
number  enrolled  it  was  impossible  to  compute  the  cost  per  credit 
or  per  pupil  hour.     In  this  report  two  cost  bases  have  been  used: 

1.  The  pupil  hour  which  is  absolute  and  means  the  same 
quantitative  amount  in  any  school  at  any  time.  By  this  standard 
we  can  measure  the  cost  of  the  same  time  unit  of  instruction, 
whether  the  year  is  long  or  short  or  the  daily  periods  long  or 
short.  The  limitation  of  this  standard  is  that  it  is  not  the  one 
of  common  usage  in  evaluating  school  work. 
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2.  ( "ost  per  cnMlit,  which  is  the  evaluation  p;iven  for  a  semester's 
work  ill  a  sul)jeet  havinj>;  one  daily  recitation,  or  it  represents 
]-'.V2  of  a  staiulard  fonr-year  high  school  course. 

Owinii  to  the  fact  that  the  school  year  varies  in  the  schools 
listed  from  32  to  40  Aveeks,  and  as  class  periods  vary  from  40 
to  70  minutes,  it  is  apparent  that  a  credit  is  not  a  standard  thing 
from  th(>  time  viewpoint.  But  it  is  a  standard  from  the  college 
entrance  standpoint  within  the  State. 

l^efore  ])reseuting  the  general  summaries  of  my  findings,  I 
wish  to  present  on  the  screen  and  discuss  with  you  for  a  few  min- 
utes the  more  important  factors  (mtering  into  instructional  costs. 

The  two  major  factors  in  instructional  costs,  as  I  see  them, 
are  teachers'  salaries  and  the  numljer  of  pupils  instructed.  Con- 
tributing factors  ar(^  \\w  length  of  the  school  year,  number  of 
teaching  periods  ]ier  day  or  wcndv,  and  the  size  of  classes,  and  the 
nature  of  the  subject  (whether  laboratory,  re(iuiring  doid)le 
pcn'iods,  or  recitation,  re(iuiring  singh^  periods  daily).  While  this 
latter  factor  does  not  count  in  cost  ])er  pupil  hour,  it  does  have 
great  influence  in  the  cost  jier  credit  of  laboratory  and  shop 
subjects. 

That  1  may  em])liasize  the  significance  of  the  different  cost 
factors  1  have  attempted  to  select  typical  cases  for  comparison 
in  which  all  but  one  of  the  factors  are  uniform  or  nearly  so. 

COST  FA  ('TO  US 
Exhibit  1.     Salary  factor. 


Group  II,  School  11 


History 


Salary 

Class  size 

Credit  period.s. . . 
Teaching  periods 
Cost  i^er  credit .  . 


SI 

0.")6* 
19.4 

o 
30 
!$4.93 

"Cliief  variable. 
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Exhibit  2.     Class  size  factor. 
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Drawing  and  Art 


Group  II, 
School  2. 


Group  II, 
School  13 


Salary 

Class  size 

Credit  periods . . . 
Teaching  periods 
Cost  per  credit .  . 


35.* 

10 

40 


Exliibit  3.     Credit  period  factor. 


Group  II,  School  10 


Manual  Arts  ^Mathematics 


Salary 

Class  size 

Credit  periods .  .  . 
Teaching  periods 
Cost  per  credit.  . 


$1,025 
16 

10* 
39 

$8.22 


$1,002 

15.5 

5* 

43.6 

$4.45 


Exhibit  4.     Teaching  period  factor. 


Latin 


Group  II, 
School  5 


Group  I. 
School  1 


Salary 

Class  size . 

Credit  periods . . . 
Teaching  periods 
Cost  per  credit .  . 


$1,030 
17.7 
5 
30* 
$4.90 


$1,038 
17.1 


$6.46 
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Exhibit  5.     Like  variants. 


Average  of  (5 roup  II 


Salary 

Class  size 

Credit  periods. .  . 
Teaching  periods 
Cost  per  erodit .  . 


Mathematics 


$800 
21.6 

f) 
35 . 1 
$3.51 


Exhibit  6.     Opposing  variants 


Average  cost  per  credit 


Salary 

Class  size 

Credit  periods.  . 
Teaching  period: 
Cost  per  credit . 


Group  III, 
School  10 


$665 
20.8 


40.6 
$2.60 


Exhibit  7.      Do  like  salaries  produce  like  costs^ 


School 


Salary 

Class  size 

Credit  periods. . . 
Teaching  periods 
Cost  per  credit . . 


Drawing 


$810 
9,5 
10 


$10.65 


Science 


Historv 


$810 

$810 

15.6 

24.5 

6.5 

5 

29 

36.5 

$5.70 

$2.66 
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Exhibit  1  shows  in  moderate  degree  the  influence  of  varying 
salaries  as  a  factor  in  cost  production. 

"Credit  periods"  refers  to  the  number  of  single  periods  a  class 
meets  weekly  to  earn  a  credit  in  a  half-year,  while  "teaching 
periods"  refers  to  the  number  of  single  periods  a  teacher  teaches 
weekly. 

In  Group  II,  School  11,  it  will  readily  be  seen  that  the  chief 
variable  in  the  cost  producing  items  is  salary,  and  that  the  cost 
per  credit  varies  approximately  in  proportion  to  the  salary. 

Exhibit  2  illustrates  the  influence  of  class  size  as  a  factor  in 
cost  production.  In  this  exhibit  all  cost  factors  are  identical 
except  class  size,  and  the  costs  per  credit  are  exactly  in  inverse 
ratio  to  the  size  of  classes. 

Monroe,  thru  the  use  of  coefficients  of  correlation,  demonstrates 
that  the  size  of  classes  is  the  major  factor  in  instructional  costs 
in  the  Kansas  schools.  This  is  due  to  the  fact  that  salaries  seldom 
vary  more  than  20  per  cent  or  25  per  cent  from  the  median,  while 
class  size  frequently  varies  50  per  cent.  This  is  the  factor  that 
deserves  most  attention  in  the  standardizing  process.  An  in- 
crease of  $200  in  salary  may  more  than  be  offset  by  an  increase 
of  3  or  4  in  the  size  of  each  class  for  the  average  teacher.  And 
with  the  standard  class  of  nineteen,  as  our  data  show  for  these 
34  schools,  it  is  quite  possible  to  increase  the  size  by  5  or  6  and  still 
have  good  working  conditions. 

Exhibit  3  illustrates  the  influence  of  the  nature  of  the  subject 
in  cost  production.  The  laboratory  or  shop  subject  with  twice 
as  many  daily  periods  for  class  work  essentially  doubles  the  cost, 
other  factors  being  equal.  Other  factors  vary  slightly,  l)ut  in  such 
a  manner  as  to  neutralize  each  other  in  this  case. 

Exhibit  4  shows  the  influence  of  the  number  of  teaching 
periods  daily  or  weekly  in  cost  production.  The  size  of  the  classes 
varies  slightly,  but  accounts  for  but  a  small  part  of  the  cost 
variation.  From  this  we  might  formulate  the  statement  that, 
other  factors  being  equal,  the  cost  per  credit  varies  inversely  as 
the  number  of  weekly  teaching  periods. 

Exhibit  5  is  intended  to  show  the  influence  of  approximately 
like  factors.     Like  factors  apparently  produce  like  results. 

Exhibit  6  offers  a  comparison  of  two  systems  in  one  of  which, 
Group  I,  School  1,  every  factor  tends  to  produce  high  costs  and 
in  the  other,  CJroup  III,  School  10,  low  costs  as  compared  with 
a  median  standard. 
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In  visiting  an  Indiana  city  this  winter  I  made  inquiry  of  tiie 
high  school  i)rincipal  concerning  his  subject  costs  and  was  in- 
formed tliat  he  had  no  tabulated  data,  but  that  the  cost  of  in- 
struction in  each  subject  was  about  the  same,  as  their  teachers' 
salaric^s  were  approximately  equal. 

I  have  selected  in  Exhibit  7  thi-e(^  subjects,  drawing,  science, 
history,  from  one  school  to  show  that  the  costs  are  not  even  ap- 
proximately the  same,  alt  ho  the  teacher's  salary  in  each  case  is 
$810.  You  see  that  each  of  the  otlier  three  cost  factors  are  unlike 
and  hence  we  should  not  exi)ect  like  costs. 
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TABLE   1. — Cost  of  Instruction  Pi:k  Credit 
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*M  represents  the  median:  \t).  tlie  first  quariilr;  and  3Q,  the  tliiid  (|iiartile. 
IQ  and  3Q  represent  the  bouiidarie.s  of  the  middle  fifty  per  cent  of  the  cases  or  the 
"zone  of  safety". 
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TABLE  2.— Cost  of  Instruction  Per  100  Pupil  Hours  (GO  :Minutes) 
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The  following  table  (3)  shows  a  comparison  of  medians  of 
the  schools  of  Groups  I  and  II  combined,  with  tlie  medians 
of  the  25  schools  of  Dr.  Bobbitt's  study. 

TABLE  3. — Cost  of  Instruction  Per  100  Student  Hours 
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Cost  of  Instruction 

How  much  should  a  community  pay  for  a  half-year's  in- 
struction in  each  of  the  most  commonly  offered  subject  groups? 
On  the  basis  of  general  principles,  costs  should  depend  upon  the 
educational  and  practical  values  of  the  subject,  but  educational 
fashions,  no  doubt,  exercise  an  appreciable  influence.  What  com- 
munity standards  of  judgment  are  I  do  not  know,  but  Table  1 
shows  the  prices  paid  by  each  of  the  34  schools  cooperating  in 
this  study  for  each  credit  attempted.  Table  2  shows  the  cost 
per  100  student-hours  for  the  same  subjects  and  schools.  One 
hundred  hours  of  instruction  is  equivalent  to  7  school  months 
or  to  143  recitation  periods  of  42  minutes  each. 

Schools  designated  as  Group  I  have  500  or  more  pupils  or 
are  located  in  cities  of  more  than  20,000  population.  Those  of 
Group  II  have  200  to  499  pupils  or  are  located  in  cities  of  from 
4,000  to  10,000  population;  while  schools  of  Group  III  hav(>  less 
than  200  pupils. 

All  the  schools  in  Group  I  and  all  but  one  in  Group  II  are 
members  of  the  North  Central  Association  of  Colleges  and 
Secondary  Schools.  But  one  school  in  Group  III  is  a  member 
of  this  association.  The  schools  of  (Jroups  I  and  II  have  an 
average  session  of  more  than  36  weeks  per  ycuir,  while  those 
of  Group  III  average  about  32  weeks  a  year. 

The  schools  within  any  group  may  be  considered  to  be  ap- 
proximately eciual  in  aims  and  standards.  No  doul)!  inequalities 
exist,   but  it  may  be  seriously  (luestioned  wiiether  there  is  any 


140  BuLLioTi.N   OF  Tin:   Extension    Division 

correlation  between  hijih  costs  and  superior  ([ualitN'  of  product. 
The  (lifTerenccs  in  cost  are  prol)ably  due  lari:;cl_\-  to  the  ai)i)lication 
or  th(^  non-ap]:)licali()n  of  llie  best  a(hninistrativ('  standards. 
A\'ithin  i)ractically  every  sul)j('c1  within  e\-erv  grouj)  some  school 
is  payiiij:;  twice  as  much  ])cr  credit  or  ])vv  100  student-hours  as 
is  some  other  school  of  that  same  <;rou]i.  Nor  is  this  Avide  variation 
confined  to  the  newer  subjecls  of  the  ))ro<i;ram,  but  is  equally 
ap])areiit  in  J'jiijilish,  histoi\\',  and  mathematics.  Reference  to 
Table  1  reveals  the  fo]lo\vin«i'  extreme  \ariations  in  the  cost  ])er 
credit  of  certain  subjects  in  the  schools  of  (irou])  I:  commercial, 
S4.01  to  S8.91;  history,  S2.<):i  to  SO. 03;  household  arts.  $0.15  to 
$13. o4;  mathematics,  82.04  to  S,"). ,")();  music,  -SI. 81  to  S().34;  and 
science,  $4.78  to  $10.33. 

Not  only  is  there  ^I'^'^^t  \aiiation  in  costs  between  s(;ho()ls  of 
the  sam(>  jirou])  for  any  subject,  but  on  (>xamination  of  Table  1 
((trou])  II  medians)  <ireat  variation  is  evident  between  the  median 
costs  of  different  subjects,  ranjiino-  from  $11.25  for  drawing  to 
$2.15  for  music,  with  foreiuii  languages  and  commercial  subjects 
occu])ying  a  median  ))lace  and  manual  arts  costing  about  twice 
as  much  as  p]nglish  or  mathematics.  The  low  cost  of  music  is 
accounted  for  by  the  excessively  large  class  size.  Classes  of  under 
30  in  music  wvn-  gi\-en  .2  ci-edit  for  e\'ery  class  ))eriod  a  we(>k 
A\  hei-e  it  was  ai)])ai'ent  from  the  dcsci-iption  of  the  course  that 
some  study  was  retiuired  outside  the  class  ])eriod.  Larger  classes 
and  chorus  grou])s  were  given  .1  credit  unless  otheiwise  s])ecified 
in  the  re])ort  of  the  school. 

In  Tables  1  and  2  the  median  costs  are  com])ute(l  for  vnvh 
subject  and  for  each  group  of  schools.  Table  1  should  be  read 
as  follows:  School  1  of  (Iroup  I  is  paying  $5.83  per  credit  for 
instruction  in  English,  and  $0.80  on  the  average  for  all  subjects 
coml)iiied.  The  median  school  of  Group  II  is  paying  $3.15  per 
credit  for  history  instruction,  and  the  zone  of  safety  lies  between 
$2.78  and  $3.99.  Blank  spaces  in  the  tables  indicate  that  no 
classes  in  these  subjects  were  re])orted  by  these  schools. 

While  it  is  neither  practicable  nor  desirable  that  every  school 
conform  to  its  grcnip  median,  yet  the  suggestion  offered  by  Dr. 
Bobbitt*  may  well  be  given  serious  consideration,  namely:  to 
keep  the  costs  M'ithin  the  limits  of  these  of  the  middle  50  per  cent 
of  the  group,  which  limits  he  designates  as  the  "Zone  of  Safety". 

Table   1  shows  that  English,  history,  and  mathematics  have 
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the  lowest  costs  (if  music  be  excluded)  while  Table  5  shows  that 
these  and  commercial  are  the  only  subjects  that  have  a  median 
class  size  of  more  than  20  pupils. 

The  cost  per  100  student  hours  is  more  uniform  from  subject 
to  subject  than  is  the  cost  per  credit,  for  the  latter  requires  daily 
double  periods  in  some  of  the  subjects  while  only  single  periods 
in  such  subjects  as  English  and  mathematics.  This  difference  in 
costs  on  the  two  bases  may  be  illustrated  by  contrasting  house- 
hold arts  and  Latin  in  the  medians  of  the  schools  of  Group  II. 
On  the  credit  basis,  household  arts  costs  $7.23  and  Latin  $4.14; 
while  on  the  100  student-hour  basis,  household  arts  costs  $5.94 
and  Latin  $6.05.  For  equal  teaching  time,  household  arts  costs 
less  than  Latin,  but  for  a  credit  on  the  school  records,  it  costs 
75  per  cent  more. 
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Figure  III  represents  graphieally  the  eost  ])er  credit  for  all 
subjects  combined  for  each  school,  and  includes  also  group  and 
total  medians.  "M"  indicates  the  medians,  and  the  horizontal 
lines  di-awn  across  tlie  cost  l)ars  indicate  the  limits  of  the  zones 
of  safety. 

The  twelve  subject  groups,  used  thruout  this  report  at  the 
top  of  each  table  involving  sul)jects,  are  as  follows:  Commercial, 
drawing  and  art,  English,  history,  household  arts,  Latin,  manual 
arts  (including  mechanical  drawing,  shoj)  work,  ])rinting,  etc.), 
mathematics,  modern  languages,  music,  ])hysical  training,  and 
science  (including  agriculture). 
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TABLE  4. — Average  Salaries  of  Teachers 


Group  and 
School 


£ 

hJ 

H 

si 

a 

s 

O 

s 

s 

Group  I 

1 

1,009 

1 ,  062 

786 

900 

1,050 
900 
990 
900 

1,189 
917 
846 
865 
925 
960 

1,036 

1,048 
900 
867 
855 
900 
1,088 
1,030 

855 
910 
846 
853 
832 
1,033 
900 

1,0.38 
874 
888 
885 
833 
979 

1,080 

1,211 
928 
814 
900 
878 
985 

1,269 

1,020 
852 
821 
870 
829 
1,005 
1,0.57 

1,100 
916 
884 
890 
930 
926 

1,101 

1,100 

1,000 

990 

900 
810 

1,.300 
1,113 
1,012 
868 
861 
1,204 
1,151 

1,094 
948 
885 
892 

878 

2  ..  . 

3 

4 

5 

6 

886 
962 

1,200 
968 

1,500 
1,350 

1,070 
1,278 

1,008 
1,065 

M  . 

931 

979 

925 

900 

855 

888 

928 

870 

926 

1,100 

985 

1,113 

948 

Group  II 

1   .  .. 

805 
810 
890 

810 

920 
1,036 
720 
900 
680 

1,.500 

765 
810 

833 
826 
815 
826 
985 
855 
860 
709 
796 
791 
950 
943 
814 
787 

756 

•  810 

919 

1,100 

1,161 

752 

810 

900 

765 

930 

1,056 

1,1.55 

765 

773 

850 
810 
675 
756 
1,036 
720 
818 
695 
727 
850 
950 
945 
765 
540 

780 
900 
810 
920 
1,036 
765 
859 
765 
765 
943 
950 
945 
800 
765 

1 ,  087 

1,100 

907 

810 

1,200 

720 

1,200 

680 

810 

1,025 

1,300 

1,000 

810 

810 

810 

898 

810 

981 

1,111 

830 

904 

680 

801 

1,002 

1,011 

1,046 

833 

810 

821 
810 
810 
756 
936 
756 
810 
680 
810 
800 
900 
945 
810 
765 

850 
810 

936 

810 

960 

1,000 

1,112 

882 

874 

680 

785 

1,025 

1,000 

1,008 

810 

841 

839 
857 
840 

•> 

3 

4 

850 

1,061 

720 

806 
720 

905 

5 

1,036 

1  046 

6 

800 

7 

810 

680 

765 

1,082 

1,024 

1,168 

810 

828 

880 

8 

707 

9 

810 
810 
900 
765 
720 
1,012 

650 

785 
921 

10 

11  . 

1  003 

12 

1,000 

13 

808 

14  .  .  . 

782 

M 

819 

810 

826 

855 

787 

835 

953 

860 

810 

810 

720 

909 

849 

Group  III 
1 

701 
810 
810 
680 
850 
700 
734 
566 
640 
680 
684 
716 
810 

713 
841 
800 
834 
1,000 
668 
749 
720 
723 
800 
800 
670 
800 

800 
765 
640 
900 
213 

722 

720 

1,000 

900 

800 
855 

800 
680 

744 
810 
920 
800 
850 
600 
763 
504 
800 
610 
800 
1,050 
920 

720 
640 

960 
675 

904 
855 
802 
748 
911 
732 
800 
644 
800 
720 
615 
815 
802 

Slid 

790 

■-> 

900 
920 

680 
680 

675 
510 

798 

3 

813 

4 

795 

5 

850 
800 
700 

510 
700 

734 

6 

700 

7 

800 
504 
800 
700 

560 

680 
714 
670 

626 
672 
640 
680 
714 
580 
640 

700 
672 
900 
709 
584 
595 
1,000 

900 
600 
800 
692 

730 

8 

560 

609 

9 

756 

10 

11 

716 
640 

680 
640 
508 

665 
707 

12 

670 
920 

712 

13 

813 

M 

700 

672 

701 

749 

676 

720 

800 

800 

720 

,i.-,s 

734 
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Fig.  IV. 

Tal)l(>  4  and  Figure  IV  show  the  average  annual  salaries 
paid  in  each  department  of  work  for  each  school.  The  median 
r(>sults  are  indicated  for  each  grou]).  The  table  should  be  read 
as  follows:  School  o  of  Group  II  is  paying  an  average  salary 
of  Sl,l()l  for  its  history  teachers,  SI, 200  in  manual  arts,  $1,112 
in  science.  Also  the  schools  of  Group  I  are  paying  a  median 
salary  of  $948;  Group  II,  S849;  and  Group  III,  $734. 

Salaries  seem  to  vary  with  the  size  of  the  school  if  we  may 
judge  by  group  medians.  However,  an  analysis  of  the  original 
data  for  the  schools  of  Group  III  shows  that  monthly  salaries 
are  as  high  as  in  Group  II,  the  annual  differences  being  due  to  the 
difference  in  the  length  of  the  term  in  the  two  groups.  The 
medians  of   Group   II   show   that   manual   training   and   science 
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teachers  receive  the  highest  salariet^,  $9"):^  atul  ${K)\),  respectively. 
No  doubt  the  liigher  salaries  in  these  departments  are  due  to  the 
fact  that  these  positions  are  generally  occupied  by  men.  Omitting 
physical  training,  which  has  but  three  representatives  in  Group 
II,  household  arts  teachers  are  paid  the  lowest  salaries  ($787), 
wdiile  teachers  of  Latin,  history,  and  mathematics  are  paid  about 
the  median  salaries  for  this  group.  In  Group  I,  science  and  music 
pay  the  highest  salaries;  household  arts,  mathematics,  and  Latin, 
the  lowest  salaries;  and  the  remaining  seven  subjects  pay  about 
median  salaries.  In  Group  III  the  highest  salaries  are  in  science, 
manual  training,  and  mathematics;  the  lowest  in  music,  drawing, 
and  household  arts;  while  the  remaining  subjects  of  this  group 
pay  about  median  salaries. 

More  noticeable  than  salary  differences  in  Group  II  are  salary 
uniformities  by  departmelits.  These  figures  give  but  little 
guidance  to  the  prospective  teacher  who  is  desirous  of  entering 
the  field  offering  the  greatest  financial  rewards.  The  higher  sal- 
aries are  paid  in  the  schools  of  Group  I.  Teachers  should  prepare 
to  teach  in  schools  of  this  group  not  only  because  of  higher 
salary,  but  also  because  of  fewer  teaching  periods  a  week  and 
because  teachers  in  this  group  tend  to  specialize  in  one  subject 
instead  of  teaching  two  to  five  subjects  as  Table  12  shows  to  be 
the  condition  in  schools  of  Group  III. 

These  figures  differ  slightly  from  those  of  Bobbitt,*  who 
found  that  teachers  of  shop  work  and  music  received  the  highest 
salaries;  science  teachers  about  the  median  salary;  and  modern 
languages  and  household  arts,  the  lowest.  The  schools  reportcnl 
in  his  study  correspond  to  those  of  Groups  I  and  II  of  this  in- 
vestigation. Monroe!  found  agriculture,  manual  training,  and 
science  paying  the  highest  salaries,  and  English  and  household 
arts,  the  lowest. 


*"High  School  Costs".     School  Review,  Oct.,  1915. 

t   Cost  of  Instruction  in  Kansas  High  Schools".      Publislicd  by  tlic  Suite  .Norma! 
School,  Emporia,  Kan. 
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Group  and 
School 


s 

g" 

< 

M 

«= 

3 

:a 

-a 

"o 

■< 

J 

H 

o 

a 

s 

c 

„ 

C3 

a 

CS 

a 

W 

W 

►J 

:s 

IS 

s 

s 

Group  I 
1... 
2  ., 
3... 
4... 
5... 
6... 
7... 


M. 


Group  II 
1... 

2.... 
3... 
4.... 
5.... 
6... 
7.... 


18.1 
13.5 
12.5 
11.0 


22.1 
31.1 


15.8 


21.1 
19.3 

28.7 


23.3 


24  5 
18.0 
14.3 
12.6 
21.2 
25.6 
15.5 
24.7 


9.2 
11.3 

9.1 
14.6 


6.8 
13.4 


21.5 
23.7 
22.1 
22.3 
20.2 
23.8 
21.0 


10.2 


22.1 


9.5 


10.0 
12.0 
8.0 
27.0 
10.0 


14.5 
9.0 
35.0 


22.8 
24.6 
21.5 
19.7 
18.6 
26.2 
21.3 
21.6 
20.8 
17.1 
17.5 
20.0 
20.3 
25.8 


16.9 
18.5 
20.4 
21.7 
26.7 
20.4 
21.1 


20.4 


17.0 
24.5 
28.5 
34.0 
21.8 
21.5 
23.5 
27.0 
22.2 
18.8 
19.4 
24.0 
25.4 
21.8 


11.3 
9.6 
22.0 
14.8 
10.5 
16.8 
15.0 


14.8 


20.0 
13.7 
21.5 
18.3 
19.7 
20.0 
24.8 
10.3 
14.7 
11.0 
21.5 
13.0 
13.3 
7.0 


17.1 
12.2 
18.8 
14.9 
16.1 
13.8 
18.0 


16.1 


15.0 
23.8 
17.3 
18.0 
17.7 
20.0 
20.1 
18.4 
14.4 
16.4 
18.2 
22.5 
16.7 
15.9 


9.2 
11.5 
15.8 
19.0 
13.9 
10.2 
15.4 


13.9 


8.0 
14.6 
11.2 
22.5 
28.0 
17.5 
22.7 
18.0 
14.3 
16.0 
15.4 
11.0 
16.5 


18.8 
20.9 
19.9 
25.5 
24.0 
20.9 
20.6 


20. 


22.3 
23.7 
20.9 
20.3 
20.5 
31.6 
22.8 
22.5 
20.4 
15.5 
24.9 
22.4 
20.2 
18.3 


16.4 
17.9 
19.9 
19.9 
22.6 
22.4 
21.1 


19.9 


18.4 
15.2 
15.5 
22.0 
10.8 
22.8 
17.0 
16.4 
23.4 
11.8 
19.5 
20.0 
16.2 
18.5 


28.0 
68.3 

9.8 


30.3 
62.0 


30.3 


97.5 
146.7 


37.5 
66.0 
87.0 


48.0 
38.0 
22.0 
28.5 
47.3 
65.5 


19.2 
14.2 


35.6 
39.8 


27.4 


13.3 
29.2 


12.6 
21.8 
20.2 
20.6 
22.0 
20.4 
21.3 


20.6 


21.1 
15.6 
18.0 
17.6 
19.0 
21.5 
15.4 
21.8 
17.4 
15.0 
12.9 
22.3 
20.3 
20.2 


15.8 
17.7 
19.0 
19.8 
19.7 
18.2 
20.5 


19.0 


20.4 
20.1 
20.8 
21.9 
19.1 
23.3 
21.3 
20.1 
19.0 
15.1 
18.6 
21.1 
19.2 
20.0 


M, 


21.2 


21.0 


22.8 


16.5 


17.8 


15.7 


21.6 


17.7 


48.0 


18.5 


Group  III 

1 

2 

3 

4 

5 

6 

7 


13  0 


25,0 


.13.0 
16.0 


16.0 


5.0 

8.0 

6.0 

25.0 


8.0 


16.0 
7.0 


9.0 
15.0 
12.5 


20.1 
19.6 
24.7 
12.2 
21.3 
13.0 
10.7 
13.6 

7.3 
25.2 

5.8 
18,8 
19.1 


19.5 
21.3 
23.7 
13.6 
22.0 

7.3 
11.0 
11.0 

4.3 
30.0 

9.0 
17.0 
26.6 


13.0 
17.8 
19.0 
5.5 
12.0 


15.0 
20.5 
11.0 
11.0 


15.7 
17.5 


17.0 
10.0 


12.0 
20.0 
12.0 
10.7 
8.0 
8.0 
7.0 


9.0 
8.0 
7.0 

20.2 
5.0 
4.6 

14.6 


8.0 
11.0 
8.0 
6.0 


15.3 
17.8 
22.0 
14.0 
21.0 
12.3 

7.7 
14.3 

7.3 
22.8 

5.0 
20.6 
19.6 


22.5 

18.2 


87.5 
25.0 


3.0 
13.3 
10.5 


48.0 
40.0 


18.0 


13.3 
14.5 


54.0 
19.0 
16.0 


14.6 
13.6 
18.8 

8.0 
10.5 

9.0 

6.0 
14.0 

4.0 
16.8 

7.0 
20.0 
17.0 


16.4 
19.5 
20.0 
11.6 
15.5 
11.0 
2 

12.1 
7 
20.8 
6.9 
14.7 
17.4 


18.8 


17.0 


12.0 


11.0 


15.3 


13.3 


32.5 


13.6 


14.7 


*Music  and  Physical  Training  omitted  in  computing  average. 
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TABLE    6. — NuMHEK    and    Peu    Cent    of    Large    and    Small    Classes 


(Jroii])           1       Tola! 

and                   iiuriihcr 
school                 classi's 

Number 

classes 

10  or 

less 

Number 

classes 

more 

than  30 

Per  (!ent 

classes 

10  or 

less 

Per  cent 

classes 

more 

tiian  30 

(ironp  I 

1        

123                   27 

4 
3 
0 
1 
7 

19 
33 

22.0 

19.0 

8.3 

9.2 

12.3 

23.7 

9.5 

3  2 

2 

3 

4 

5 

139                   2() 
120                    10 
109                    10 
IOC)                    13 
190                   4') 

2 . 0 

0() 

•) 

<')  r> 

() 

10  0 

7 

243 

23 

13  () 

Average 

147 

22 

9.6 

14.5 

6.5 

(iroup  11 

1 

2 

.3 

4 

o 

().  .  ; 

85 
68 
89 
3o 
57 
39 
97 
41 
50 
52 
74 
53 
57 
54 

8 
7 
5 
2 
8 
0 
4 
3 
2 

10 
9 
4 
3 

8 

3 

8 
4 
2 
4 
9 
9 
2 
2 
1 
3 
0 
4 
6 

9.4 

10.3 

5 . 6 

5.7 

14.0 

0.0 

4.1 

7.3 

4.0 

19.2 

12.2 

7.5 

5.3 

14.8 

3 . 5 
11.8 
4.5 
5  7 
7  () 
23    1 

7 

9  3 

S 

4   9 

9 

1  0 

10 

11 

12 

13 

14 

1    <) 
1.  1 
0.0 
7.0 
11.1 

Average 

60 

5.1 

4 

8.5 

6.7 

Group  111 

1 

2 

3 

48 
28 
31 
18 
22 
17 
16 
21 
15 
36 
13 
25 
30 

9 
1 
5 
8 
4 
7 

12 
7 

13 
3 

12 
6 
5 

3 
2 
3 
0 
4 
0 
0 
0 
0 
4 
0 
0 
0 

18.7 
3.5 
16.1 
44.4 
18.2 
41.2 
75.0 
33.3 
86.7 
8.3 
92.3 
24.0 
16.7 

6.2 
7.0 
9  7 

4 

5 

6 

0.0 

18 . 2 

0.0 

0  0 

8 

0  0 

9 

0  0 

10 

11 

12 

13 

.   11.1 

0.0 
0.0 
0.0 

Average 

24.4 

7.1 

1.2 

28.8 

5.3 
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TABLE   7.— Number  and  Per  Cent  of  Veuv  Smam,   and  Very  Large 
Classes  by  Groups  and  Sun.iKf-T- 


Class   Items 

1 
1 

a 

< 

Q 

c 

o 

1 

3 

O 

•2 

3 

5 

S 

3 
C 

.J 

3 

to 
c 
'H 
E 

"a 

>. 

tm 

> 
< 

Group  I 
Total    number 

classes 

Number  classes 

97 

43 

178 

106 

63 

79 

81 

141 

90 

23 

46 

93 

1,040 

10  or  less 

Mumber  classes 

18 

30 

8 

5 

19 

15 

32 

6 

7 

3 

2 

9 

154 

more  than  30 
Per  cent  classes 

15 

0 

6 

2 

1 

0 

0 

2 

2 

12 

24 

3 

67 

10  or  less.. . . 
Per  cent  classes 

14.8 

70.0 

4.5 

4  7 

30.2 

19,0 

39.5 

4.3 

7.8 

13.0 

4.3 

9.7 

14.5 

more  than  30 

14.2 

0.0 

3.4 

1.9 

16 

0.0 

0.0 

1.4 

2.2 

52.2 

52.2 

3.2 

6.5 

Group  II 
Total    number 

classes 

Number  classes 

73 

13 

180 

84 

45 

87 

37 

135 

75 

24 

17 

83 

853 

10  or  less.. . . 
Number  classes 

7 

5 

2 

1 

7 

11 

12 

7 

8 

3 

1 

9 

73 

more  than  30 
Per  cent  classes 

9 

1 

13 

8 

2 

0 

0 

4 

2 

13 

4 

1 

57 

10  or  less. 
Per  cent  classes 

9.6 

38.5 

11 

1.2 

15  5 

12  6 

32.5 

5.2 

10.7 

12.5 

5.9 

10.8 

8.5 

more  than  30 

12.3 

7.7 

7.2 

9.5 

4.4 

0.0 

0.0 

3.0 

2.7 

54.1 

23  5 

1.2 

6.7 

Group  III 
Total    number 

classes 

Number  classes 

8 

10 

67 

36 

21 

36 

11 

50 

19 

16 

45 

319 

10  pr  less. . . . 
Number  classes 

4 

2 

13 

10 

6 

20 

4 

12 

5 

0 

16 

92 

more  than  30 

0 

3 

1 

2 

0 

1 

0 

1 

0 

8 

1 

17 

Per  cent  classes 

10  or  less 

Per  cent  classes 

50.0 

20.0 

19.4 

27.8 

28.6 

55.6 

36.4 

24.0 

26.3 

0.0 

35.6 

28.8 

more  than  30 

0.0 

30.0 

1.5 

5.5 

0.0 

2.8 

0.0 

2.0 

0.0 

50.0 

2.2 

5.3 

Tal)lo  5  and  Figure  V  show  the  facts  relative  to  size  of  classes 
wliich  is,  perhaps,  the  most  important  factor  in  cost  production. 

Music  and  physical  training  have  been  omitted  from  the  school 
averages  in  computing  the  right-hand  column  of  the  table,  the 
latter,  because  of  its  rare  occurrence  and  its  wide  variability,  and 
the  former,  because  of  its  excessive  variation  (13  to  147).  When 
music  classes  are  included,  the  average  class  size  of  a  school  is 
often  raised  by  5  or  10,  due  to  the  fact  that  some  of  these  chorus 
groups  often  total  150  to  200  pupils.     The  average  size  of  music 
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('hisses  is  al)()ut  two  uiid  onc-luili'  tinics  that  of  other  classes 
consitU'red  collectively. 

Every  <i;roup  exhil)its  wide  x'ariations  in  size  of  classes  in 
different  de])artnients.  The  only  subjects  that  seem  to  have 
attained  a  standard  favorinji;  a  moderate  cost  are  Enj2;lish,  history, 
and  niatheniaties.  These  are  the  only  subjects,  aside  from  music, 
thai  have  an  averaji;e  size  of  20  pupils  or  more  in  all  ji'roups  com- 
bined. Di'awinji',  household  arts,  and  manual  ai'ts  classes  are 
far  below  averaf;"e  size  in  all  groui)s.  These  sul)jects  have  highly 
desirable  values,  but  it  may  b(^  honestly  doubted  whether  they 
are  worth  from  two  to  foui-  times  the  other  subjects  of  the  curri- 
culum as  ai)])ears  in  Table  1. 

The  avera!ii;e  class  size  is  small  in  (iroup  111  because  of  the 
small  total  enrollment  in  these  schools,  one  of  the  number  havinj^ 
as  f("W'  as  20  i)upils.  Hut  few  teachers  enter  the  service  of  schools 
in  (Jrou])s  I  and  II  without  at  least  two  years  of  teaching  ex- 
])erience.  (iraduation  from  a  standard  colh^ge  and  some  i)ro- 
fessional  training  ai'e  also  the  rule.  In  the  light  of  these  facts, 
it  does  not  seem  unreasonable  to  the  writer  to  standardize  the 
average  class  in  these  schools  at  24  or  25  pupils  instead  of  at  19 
or  20.     The  difference  in  costs  would  be  a  very  material  one. 

Why  have  standard  class  groups  of  10  or  15  as  in  the  case 
of  the  sul)jects  of  drawing,  household  arts,  and  manual  arts? 
The  elective  system,  no  doubt,  accounts  for  it  in  })art,  but  other 
elective  subjects  are  standardized  at  a  much  higher  level.  The 
argument  for  small  classes  for  the  purpose  of  individual  instruction 
applies  no  more  to  drawing  than  to  English. 

A  better  administration  of  the  elective  system  will  tend  to 
greatly  reduce  costs.  To  illustrate  variable  administrative  prac- 
tice in  the  same  school,  an  example  from  one  of  the  largest  schools 
reporting  is  here  given.  In  this  school  8  Latin  courses  are  offered, 
but  in  the  126  grade  only  6  pupils  are  enrolled  for  Latin,  and  in 
the  12 A  grade  l)ut  four.  One  teacher  is  giving  more  than  one- 
third  her  time  to  10  i)upils  at  a  cost  of  about  $13  a  credit.  In 
the  German  department  of  the  same  school  the  12A  and  r2B  grades 
are  combined  for  fourth  year  German,  and  the  12  pupils  here 
enrolled  receive  instruction  at  a  cost  of  $6  per  credit.  Economical 
administrative  practice  would  indicate  that  in  many  subjects 
having  small  classes  there  should  be  an  organization  on  the 
year  rather  than  on  the  half-year  basis,  and  in  the  smaller  schools 
there  should  be  an  alternation  of  courses  in  the  eleventh  and 
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twelfth  grades.  One  school  reporting  has  (>  half-year  courses  in 
household  arts  with  not  more  than  8  i)upils  in  any  class.  In 
such  a  situation  it  would  seem  quite  possible  to  effect  a  re- 
organization providing  for  3  classes  with  15  or  IG  pupils  per 
class.  The  cost  of  one  fuU-tinu^  teacher  would  be  thus  saved. 
In  certain  cases  where  very  small  classes  are  unavoidable,  ar- 
rangements might  be  made  to  have  each  class  recite  for  a  period 
of  20  or  25  minutes  instead  of  45.  Two  such  short-period  classes 
could  be  considered  as  the  equivalent  of  one  regular  class  in  the 
assignment  of  the  teacher's  time.  One  school  of  Group  I  has 
20  classes  in  drawing  and  art  and  every  class  has  an  enrollment 
of  10  or  less.  Here  again  one-half  the  cost  could  be  saved  by 
doubling  the  class  size,  which  would  seem  to  be  entirely  possible 
in  a  school  of  this  size  without  in  any  way  reducing  the  number 
of  courses  offered. 

Table  6  shows  the  number  and  per  cent  of  classes  having  10 
or  less  pupils  or  more  than  30,  by  schools  and  groups.  The  table 
should  be  read  as  follows:  School  1  of  Group  I  has  123  classes 
of  which  27,  or  22  per  cent,  have  10  pupils  or  less,  and  4  classes, 
or  3.2  per  cent,  have  more  than  30  pupils. 

The  high  per  cent  of  very  small  classes  in  Group  III  (28.8) 
is  due  to  the  small  enrollment  in  these  schools;  while  the  fairly 
high  per  cent  (14.5)  in  Group  I  is  due  in  part  to  the  great  variety 
of  electives  offered,  but  is  also  the  result  of  poor  administrative 
practice  referred  to  above.  The  variations  in  administrative 
practice  are  great  within  any  group.  For  example,  school  (>  of 
Group  I  has  23.7  per  cent  of  very  small  classes,  while  school  3 
has  but  8.3  per  cent.  In  Group  II  school  10  has  10.2  ])er  cent  of 
very  small  classes,  while  school  6  has  none.  In  Group  III  school 
11  has  92.3  per  cent  of  small  classes,  and  school  2  has  3.5  per  cent. 
With  respect  to  classes  of  more  than  30  pupils.  Group  I  has  a  range 
from  0  per  cent  to  13.6  per  cent;  Group  II,  0  per  cent  to  23.1 
per  cent;  and  Group  III,  0  per  cent  to  18.2  per  cent. 

Table  7  indicates  the  number  and  per  cent  of  very  small  and 
very  large  classes  by  groups  and  subjects.  The  table  should  be 
read  as  follows:  In  Group  II  there  are  73  classes  reported  in 
commercial  subjects  of  which  7,  or  9.6  per  cent,  have  10  or  less 
pupils,  and  9,  or  12.3  per  cent,  have  more  than  30  ])upils.  In 
Group  II,  7  of  the  12  subjects  (drawing,  hous(>hold  arts,  Latin, 
manual  arts,  modern  language,  music,  and  science)  have  more 
than  10  per  cent  of  their  classes  with  10  or  less  i)\ii)ils.     lu  Iwo 
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of  these  subjects  ((lra\vin,a;  uiul  maiui;il  arts)  more  than  'JO  per 
cent  of  the  chisses  have  10  or  h'ss  pupils.  Seventy  per  cent  of 
drawing  classes  in  Clrou])  I  have  10  or  less  pu])ils.  Couiniereial 
subjects,  music,  and  physical  ti-ainiua;  show  a  hijih  p(>r  cent  of 
oversize  classes,  but  as  physical  Irainiui;-  is  i-eported  from  but 
'A  of  the  schools  of  this  «;tou]),  it  can  hardly  be  said  that  this  sub- 
ject contributes  much  in  the  way  of  oversize  classes  to  the  total 
situation. 

Table  8  indicates  a  fairly  close  a.iireenuMit  as  to  staiulard 
size  of  classes  whether  the  schools  be  in  Indiana,  Kansas,  or  in 
schools  of  several  of  the  central  States. 

Tal)le  S  shows  a  comparison  of  medians  of  (iroups  I  and  II 
of  this  study  with  medians  as  determined  by  iiobbitt  for  2.') 
cities,  and  medians  found  by  Monroe  for  ')l  Kansas  cities  of 
the  tii'st  and  second  class. 


TABLK  S.  ^Sizi;  oi    Classks 
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Indiana  (21) 

(Childs) 

20.3 

10  0 

21  5 

21  8 

14  <S 

17.3 

15  4 

20  9 

18.5 

47.7 

19.2 

20  2 

19,7 

Central    States 

(25)  (IJohbitt) 

19  0 

ISO 

22,0 

21.0 

17  0 

17.0 

14.0 

21.0 

17.0 

58.0 

32.0 

20.0 

19  0 

Kansas  (54) 

(Monroe).  .  . 

19.0 

21.8 

21.5 

15.5 

15.3 

13.5 

21.x 

15.7 

19.7 

19.0 
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TABLE    9. — Number    of    Class    Periods    a    Week    Per    Teacher 


Group  and 
School 
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s 
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^ 
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a 

c 
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^ 
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E 

5 

o 

C 
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W 
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Group  I 
1 
2 

3 

4 

5 

6 

7 

M 

Group  II 
1 

2.   . 
3... 

4... 
5  ... 


Group  III 

1     .. 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 


22.5 
35.0 
36.5 
37.5 

25. 
33  1 

34.0 


30.6 
35.0 
39.0 

30.0 

44. 

35. 

30 

46. 

33. 

36. 

37.5 

33.1 


35. 


40. 
37. 

40. 
35 
40. 
38.4 

40. 
37. 


25,0 
35.0 
40.0 
30  0 

25. 
28.0 


40  0 

35.0 

35.0 

40. 

40. 

35. 


25.0 

31.7 

37.5 

36.6 

28.7 

25. 

23.5 

28. 


28.4 
37.0 
32.3 
32.1 
32.4 
41.8 
31.8 
30.5 
33,5 
36.2 
30.5 
33.8 
34.8 
30. 

32.3 


25  0 

33.9 

40. 

35.0 

37.3 

25. 

28.0 

33.9 


30.8 

38. 

35.0 

35.0 

30.0 

43.2 

36, 

30. 

35. 

40. 

30. 

35. 

37. 

34. 


35. 


40.7 

39. 

35. 

42. 

41. 

36. 

40. 

40. 

36  5 

42. 

40. 

40. 

35. 


22. 

35.0 

33.5 

32.3 

37.0 

25, 

28.2 

32.3 


30,0 

40.0 

40.0 

35.5 

36. 

40. 

40. 

36.5 

30,4 

37, 

30, 

35. 

35. 

40. 

36.2 


25.0 

32.2 

38.6 

30.0 

35.0 

25. 

28.2 

30.0 


28.6 

38.5 

34.4 

35.2 

30. 

35. 

35. 

35. 

35. 

40. 

30. 

30. 

38. 

35. 

35. 


39.6 
40, 
31, 
42. 


25.0 

33.5 

40.0 

40.0 

37.5 

24. 

31.7 

33  5 


30  0 

40.0 

36.7 

36.0 

40. 

45. 

45. 

40. 

30. 

39, 

30 

35. 

40. 

40. 

39.5 


25.9 

34.6 

38.3 

38.0 

37.3 

25. 

29.3 

34. 


30.3 

33.2 

35.3 

35.0 

36. 

38.4 

31.9 

32. 

35.5 

43.6 

30.6 

40. 

37.1 

35. 

35.1 


25.0 

31.0 

35.0 

31.4 

33.6 

25. 

30.7 

31.0 


30.1 

38.5 

35.0 

35.0 

35. 

37. 

30. 

35. 

30. 

35. 

30. 

30. 

38. 

40. 

35. 


40. 

29.8 

40. 
40. 
40. 


25.0 
35.0 
40.0 


28. 
30.0 


24.0 
40.0 

35.0 

35. 

40. 


35.0 
35.0 


28.4 
35.5 


35.0 


25.0 
31.7 
38.0 
30.7 
28.3 
26.4 
29.9 


30.8 

29.0 

36.3 

32.0 

29.4 

45.6 

30.4 

32.6 

33. 

39. 

35. 

36. 

30. 

30.7 

32.3 


44. 

38. 

29. 

42. 

40.1 

40. 

40. 

40. 

40. 

40. 

35.7 

40. 

35.6 


24.9 
34  2 
38.2 
34.9 
33.5 
25.1 
28.4 

33.5 


29.8 
35.9 
35.5 
34.0 
33.2 
41.5 
34  6 
32.4 
33.3 
39.5 
31.0 
34.8 
36.3 
34.3 

34.4 


40.6 

39.6 

31.5 

41.7 

40.0 

38. 

39.3 

38. 

37.7 

40.6 

34.7 

40. 

35.5 


40. 


40. 


40. 


39.3 
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Ni'MBKR  OF  Class  Periods 

Tal)lo  \)  and  Miiurc  \'I  show  the  iiuinhcr  of  class  ])('ri()(ls  a 
W(M'k  ])("!•. Icachcr  \)\  subjects,  sciiools,  and  <i;r()U])s.  T1h>  avcras*' 
number  of  class  periods  a  week  is  j>;reater  in  Ihe  small  schools  than 
in  the  laro'e  schools. 


■26 


AVERA(3E  m  OF  ClhSS  PERI0D5 
A  WEEK  PER  TEACHER 

Fic.  vr. 

Schools  1  and  (>  of  Group  I  show  a  small  numl)er  of  class  periods 
a  week  per  teacher,  and  reference  to  Ta])le  6  shows  these  schools 
to  have  the  largest  numljer  of  class  hours  a  week  per  teacher. 
This  is  accounted  for  by  the  fact  that  these  schools  have  com- 
bined recitation  and  supervised  study  periods  of  75  and  70  minutes, 
respectively.  The  teachers  in  these  schools  are  practically  free 
from  special  conference  hours  which  are  generally  recjuired  in 
high  schools  as  extra  time. 
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Reference  to  Table  14  in  (ionnection  with  Tabic  U  indicates 
that  tliirty  periods  a  weelc  is  the  standard  teaching  time  in  Ihe 
schools  of  Groups  I  and  II.  The  excess  shown  in  Tabic  U  repre- 
sents assembly  and  extra-class  assignments.  In  Group  III  the 
weekly  teaching  time  is  about  35  periods,  with  5  periods  for  as- 
sembly duty. 

The  tendency  in  schools  of  Groups  I  and  II  to  require  less 
class  work  of  the  English  teachers  than  the  average  for  other 
departments  is  commendable  in  view  of  the  theme  work  of  the 
English  teachers.  Just  why  the  subject  of  drawing  in  Group  I, 
which  has  a  moderate  salary  cost  and  an  average  class  size  of  10, 
should  also  be  one  requiring  a  small  number  of  class  periods  a 
week,  I  am  unable  to  say.  Such  subjects  as  drawing  and  music 
require  the  least  outside  preparation  and  work  on  the  part  of  the 
teacher  and  should  be  given  a  maximum  of  classroom  periods 
weekly  rather  than  a  minimum. 

A  standard  of  30  teaching  periods  a  week  and  5  assem])ly 
periods  would  seem  to  be  the  highest  maximum  desirable  for 
schools  of  Groups  I  and  II.  As  a  matter  of  fact,  the  North 
Central  Association  at  its  recent  meeting  fixed  this  as  a  maximum 
standard  because  this  was  the  generally  accepted  standard  in 
practice  and  it  was  thought  that  a  few  accredited  schools  were 
requiring  too  many  periods  of  extra-class  work  from  their  teachers 
to  maintain  the  highest  standards  of  efficiency  in  preparation. 
For  economic  reasons  the  standard  for  schools  of  Group  III  will 
probably  best  remain  at  40. 
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TAHLK    10. — NiiMiiioit  ok  Class   Mouks   a   Week   I*ek  Tkacheh 
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23  3 

24  5 
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26  2 
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28.0 
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28,0 
20.0 
26  7 


26.7 


31  2 
23  8 
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25  4 
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17.6 
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28.5 
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21  0 
29  2 
22.5 
26  2 
28.0 
30.0 


32  4 
26.0 
26.8 
26.6 
26  1 
29.2 
22  0 

26  6 


22  1 
26.5 
23.3 
25  2 
25  6 
22  3 
22.4 
24.9 
32.7 
23.0 
30  0 
26.0 
26.2 

25  1 


31  2 
23.2 
24.5 

22  1 

23  5 
29.2 
23  0 

23  5 


22.6 
25.7 
26.2 

23  3 

24  5 
24  7 
21.0 
24  5 

21  0 
26,2 

22  5 
22  5 
26,6 
30,0 

24  5 


26,7 
22,4 

28,7 
26,7 
26  7 
26,7 


26,7 
23,3 


31  2 

26,3 
28,0 


35  1 

22 , 5 


18  0 
26,7 


21  0 
30  0 

22  5 
26,2 
28,0 
26.2 

26.2 


26.7 
28.0 


23  3 
23 . 3 

26.7 

28.0 

6.7 

26.7 


26.3 
24  5 


36.2 
26,6 


26,2 


31.2 
23.8 
26.6 
21.5 
19  8 
30  8 
22  5 


23  1 
19.3 
27.2 
21  3 
20  6 
30  4 
21.3 
22.8 
23  0 
29  2 

26  2 

27  4 
21.0 
23.0 

23.0 


29.3 
25.3 
21  8 
28.0 
26.8 
26.7 
26.7 
26.7 
26.7 
26  7 
23.8 
26.7 
23  7 

26.7 
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NuMBEK  OF  Class   Hoiks 

Table  10  indicates  the  niuuber  of  (>()-iniiuitc  hours  spent 
weekly  by  teachers  in  class  and  assembly  duties  in  these  schools 
by  departments  and  groups.  The  teachers  of  (Iroup  III  schools 
work  more  periods  and  also  more  hours  than  in  either  (Iroups 
I  or  II.  Teachers  of  Group  I  average  .9  period  less  jier  week 
than  in  Group  II,  but  their  actual  time  in  hours  is  2.2  more,  due 
to  the  somewhat  longer  class  period  in  these  schools.  (In  this 
rei)ort,  the  intermission  iK'tween  classes  has  been  included  in  the 
recitation  time  because  the  majority  of  schools  did  not  indicate 
the  time  in  such  a  manner  that  the  length  of  the  intermission 
could  be  determined.)  Twenty-five  hours  a  week  of  regularly 
assigned  school  duties  recpiiring  instruction  or  supervised  study 
groups  seems  to  be  the  standard  for  these  schools,  and  the  average 
length  of  class  period  is  42  minutes.  The  median  for  the  schools 
of  Groups  I  and  II  is  24.8  hours  a  week.  Bobbitt  found  a  median 
of  23.2  hours,  but  his  investigation  is  based  on  teaching  time 
only,  wdiile  this  report  includes  study  hall  duty  with  recitation 
time. 

Number  of  Student  Hours 

The  teacher's  total  load  is  determined  by  two  factors:  first, 
the  numl)er  of  classes  daily  (the  most  important  factor),  and 
second,  tiie  number  of  pupils  in  all  classes.  By  combining  these 
two  factors  and  stating  the  result  in  hours  instead  of  class  periods, 
we  may  say  the  teacher's  load  is  determined  by  the  number  of 
student-hours  a  week  which  her  work  represents. 
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TABLE   11. — NuMBEU  of  Student  Hours  a  Week  Per  Teacher 


Group  ami 

School 

3 

a 
a 

o 
O 

1 

-13 

a 
a 
at, 
_c 
"5 

Q 

a 

< 

"o 

j= 

s 
o 
K 

< 

3 

c 
a 

a 

S 

1 

C 

a 

a 

■o 
o 

s 

3 

a 

"a 

.Si 

a 
1 

1 
> 
< 

Group  I 

1   

.539 
366 
320 
390 

264 
296 
212 
308 

673 
555 
612 
,567 
414 
692 
358 

522 
470 
582 
531 
700 
595 
466 

313 
252 
4.32 
335 
323 
490 
318 

535 
296 
509 
313 
395 
402 
385 

288 
289 
443 
538 
375 
260 
392 

618 
541 
536 
680 
627 
609 
436 

513 
415 
489 
444 
531 
652 
487 

864 

1,791 

260 

.502 
346 

393 
475 
579 
440 
385 
616 
476 

514 

2 

434 

3  

508 

4 

470 

5 

450 

6  

64.5 
628 

192 
303 

691 

1,248 

1,182 
1,061 

576 

7 

465 

M    

465 

280 

567 

531 

323 

395 

375 

609 

489 

864 

732 

475 

470 

Group  11 

1  

2 

.542 
730 
815 

250 

242 
298 
216 
760 
245 

420 
238 
980 

301 
682 
,521 
420 
423 
732 
485 
460 
492 
464 
400 
502 
480 
581 

392 
629 
748 
793 
535 
619 
592 
567 
514 
565 
457 
629 
658 
557 

450 
357 
645 
429 
496 
533 
685 
264 
331 
308 
348 
168 
329 
210 

321 
610 
4,53 
423 
433 
465 
492 
451 
352 
493 
409 
.507 
443 
416 

194 
525 
315 
470 
784 
524 
679 
.504 
302 
468 
373 
245 
4.30 
254 

.507 
523 
5,53 
473 
515 
806 
510 
.506 
508 
.507 
.572 
672 
526 
480 

415 
.381 
407 
513 
264 
560 
416 
335 
.573 
308 
439 
4.50 
431 
555 

1,758 
2,110 

491 
299 
457 
379 
396 
647 
329 
455 
347 
409 
.328 
589 
496 
435 

471 
592 

3 

538 

4   

982 
1,061 
2,320 

292 

778 

472 

5 

592 

466 

6  

641 

7 

7.53 
441 
301 
690 
531 
689 
409 
611 

531 

8 

438 

9   

1,010 
1,144 
492 
413 
1.488 
1,379 

420 

435 

10 

485 

11 

429 

12. 

.526 

13 

489 

14 

499 

M 

601 

250 

■l^' 

,".si 

352 

447 

449 

511 

423 

1,144 

420 

422 

487 

Group  III 
1 

525 
498 
555 
300 
,568 
303 
320 
334 
170 
706 
143 
500 
449 

529 
.549 
623 
387 
602 
175 
330 
293 
105 
8.50 
240 
453 
620 

293 
475 
442 
181 
240 

396 
545 
256 
308 

417 

448 

492 
252 

439 
474 
618 
402 
560 
325 
217 
334 
195 

600 
398 

2,333 
705 

462 
335 
.332 
209 
324 
240 
176 
355 
104 
442 
214 
533 
381 

470 

2 

3 

344 

705 

497 
457 

4 

336 
392 

372 

313 

5 

6 

80 
352 
316 

875 
846 

405 
323 

7 

144 

187 
160 
639 

213 

255 

300 

1,.333 

333 
.508 
280 
301 
160 
212 
161 

269 
213 
188 
572 
136 
124 
340 

212 
293 
213 
160 

248 

8 

9 

480 

318 
179 

10 

11 

565 
136 
.551 
483 

3.55 
338 

1,.575 

125 

1,706 

608 
160 

12 

13 

305 
170 

444 

407 

M 

305 

336 

449 

453 

286 

269 

272 

439 

352 

860 

332 

405 
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Table  11  shows  this  factor  for  each  school,  group,  and  subject. 
Reference  to  the  right-hand  total  column  shows  that  480  is  about 
the  "standard  for  schools  of  Groups  I  and  II,  and  405  for  Group 
III.  The  variations  between  subjects  within  any  school  are  far 
more  marked  than  are  variations  between  school  totals.  Here 
again,  with  the  exception  of  music,  the  subjects  that  require  the 
least  work  in  preparation  and  correction  seem  to  be  the  ones 
to  escape  with  the  lightest  load. 

Number  of  Different  Subjects  Taught  by  Teachers 

Another  important  factor  in  the  teacher's  load  is  the  number 
of  different  subjects  which  he  or  she  is  called  upon  to  teach.  The 
fewer  the  number  of  subjects  and  the  more  closely  related  they 
are,  the  less  will  be  the  daily  work  of  the  teacher  in  preparation 
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"IWBLK    12.     Ni'MUKR   AND   Per   Cent   of  Teachers   Who   Teach    One 
Two.  'I'hkkk,  or  Four  or  Morio  Different  Subjects 


(;i{()Ui' 
A  N I ) 

SCIIOOI 


Groui)  I 
1 

29 
21 
20 

18 

18 
30 

48 

29 
25 
25 
21 
19 
33 
53 

100 

84 
80 
86 
95 
91 
94 

2 

4 
T) 
3 
1 
3 
o 

16 

20 

14 

5 

9 

6 

3.  .  . 

4 .  .  .  . 

f) 

6 

7 

Totals.. 

184 

19 

203 

91 

9 

(J roup  II 
1.  .  .  . 

20 

9 

11 

0 

i) 

2 

12 

7 

') 

(5 

12 

10 

() 

7 

2 
3 
4 
3 

r, 

6 
5 
2 
4 
3 
2 
2 
o 
o 

22 
13 
15 

8 
14 

9 
18 
12 
10 
10 
14 
14 
11 
12 

91 
()9 
7-.', 
()3 
64 
22 
67 
58 
50 
()0 
8(> 
72 
55 
58 

9 
23 
27 
37 
36 
()7 
28 
17 
40 
30 
14 
14 
45 
42 

2.  ..  . 
3 

1 

s 

4 

5 .  .  .  . 

7.  .  .  , 

8.  .  .  . 
0.  .  .  . 

10   . 
11 

1 

1 
2 
1 
1 

1 

11 

5 
17 
10 
10 

8 

12. . . . 
VA... 

2 

14 

14. . . . 

Totals. . 

121 

51 

9 

1 

182 

66 

28 

5 

1 

Group  III 

1.  .  .  . 

2.  .  .  . 
3  .  .  . 

4 
3 
f) 

3 
1 
3 

3 
2 

10 
6 
8 
3 
5 
3 
4 
5 
3 
6 
4 
() 
6 

40 
50 
63 

30 
17 
37 

30 
33 

4 

2 
1 
1 
2 
2 
3 
3 

3 

1 
1 

2 

67 
20 
33 
50 
40 
100 
50 

50 

33 

5.  ..  . 
6 

1 

3 
2 

1 
2 

20 
20 

()0 
67 
25 
40 

7 

25 

8 

9.  . 

1 

10.  .. 

3 
1 
2 
4 

25 
17 
33 

50 
25 
33 

67 

11.  .  .  . 

12 

13 

1 

1 
2 

50 

Totals. . 

18 

25 

22 

4 

69 

26 

36 

32 

6 
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Table  12  shows  the  facts  relative  to  the  number  of  subjects 
taught  by  teachers  in  the  schools  covered  by  this  study.  Th(> 
table,  however,  does  not  tell  the  whole  story,  for  a  teacher  inigiit 
be  credited  as  teaching  science  (one  subject),  but  the  schedule 
might  show  this  teach(>r  teaching  two  or  three  sciences  having 
but  little  in  common.  This  latter  condition  applies  more  to  the 
smaller  schools  than  to  the  larger,  and  if  taken  into  account  would 
tend  to  increase  the  number  of  schools  in  that  group  showing 
a  large  per  cent  of  teachers  having  four  or  more  subjects. 

This  table  shows  clearly  that  the  number  of  subjects  per  teacher 
increases  as  we  proceed  from  the  larger  to  the  smaller  schools. 
Ninety-one  per  cent  of  teachers  in  Group  I  teach  but  one  subject; 
66  per  cent  in  Group  II;  and  but  26  per  cent  in  Group  III.  No 
teachers  in  Group  I  teach  more  than  two  subjects;  6  per  cent  in 
Group  II;  and  38  per  cent  in  Group  III. 


TABLE   13. — Average  Number  of  Pupil  Enrollments  Per  Teacher 


Group  I 

Group  II 

Group  III 

School 

Aca- 
demic 

Spe- 
cial 

Total 

Aca- 
demic 

Spe- 
cial 

Total 

Aca- 
demic 

Spe- 
cial 

Total 

1 

2 

3 

4 

5 

6 

7 

H 

1.52 
141 
157 
107 
121 
114 
92 

108 

58 

65 

139 

120 

157 

67 

142 
115 
135 
119 
121 
128 
82 

181 
147 

i;^4 

138 
124 
133 
139 
133 
138 
145 
112 
112 
118 
112 

202 
286 
163 
108 

57 
223 
146 

77 
230 
114 
139 

87 
141 
136 

188 
187 
138 
130 
111 
152 
141 
117 
158 
138 
119 
110 
124 
118 

185 

88 

148 

84 

125 

130 

128 

131 

122 

74 

98 

50 

47 

302 

134 

423 

423 

153 

204 

49 

150 

65 

43 

85 

87 

39 

209 
94 
211 
105 
136 
1.50 
120 
136 

9 

115 

10 

68 

11 

95 

12 

63 

13 

45 

14 

Med 

121 

108 

121 

133 

140 

134 

122 

134 

115 

♦Study  hall  enrollment  is  not  included  in  this  table. 
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Number  of  Pupils  Instructed 

Table  13  shows  the  avera<2;e  number  of  jnipil  enrollments 
in  the  elasses  of  each  teaeher  in  each  school  and  group.  The 
tabuhition  omits  individual  subjects  and  gives  the  results  for 
those  subjects  when  grou])e(l  together  as  academic  (English, 
history,  Latin,  mathematics,  •modern  language,  science)  and 
special  subjects  (commercial,  drawing,  household  arts,  manual 
arts,  music,  and  ])hysical  training).  If  music  were  omitted  the 
nundx^'  in  the  sjiecial  subject  colunni  would  be  much  reduced. 
Another  reason  for  the  higher  nundx'r  uinler  "special"  is  that  many 
of  these  classes  meet  Init  one  or  two  ])eri()ds  a  week.  This  in- 
creases th(>  nund)er  of  enrollments  for  these  teachers  if  they 
teach  ai)])r()ximately  the  same  nund)er  of  ])(>riods  weekly  as 
teachers  of  academic  subjects.  The  numbers  indicated  in  Table 
13  are  from  10  to  50  per  cent  greater  than  those  reported  by 
Monroe  for  Kansas  schools. 

Co.Mi'AuisoN  of  Study   Hall  and  iNsTJiucTioNAL  Costs 

As  indicat(Ml  previously  in  this  rej)ort,  study  hall  cost  has 
been  included  in  instructional  costs.  As  several  schools  did  not 
report  the  nundx'i-  of  ])U])ils  in  their  various  assembly  study 
periods,  the  study  hall  cost  ])er  100  i)upil-hours  could  not  be 
computed. 
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TABLE    14. — Per    Cent    the    Study    Hall    Cost  is  of  Instructional 
Cost  and  Average  Size  of  Study  Hall  Croitps* 


Group  I 

Group  II 

Groi 

p   III 

School 

Average 

Average 

Average 

Per 

size  of 

Per 

size  of 

Per 

size  of 

cent 

class 

cent 

class 

cent 

class 

cost 

groups 

cost 

groups 

cost 

groups 

/     4t 

60t     \ 

1 

\(45) 

(16.0) j 
38 

16 

66 

'?1 

X 

2 

20 

14 

91 

24 

47 

3 

20 

50 

10 

113 

22 

77 

4 

9 

167 

17 

74 

29 

30 

5 

16 

56 

12 

132 

14 

44 

6 

40 

7 

18. 2t 
120 

23 
10 
16 
16 
15 
10 
12 
20 
13 

79 
135 
91 
X 
85 
71 
61 
61 
91 

7 

8 

9 

29 
27 

X 

10 

58 

11 

12 

8 
23 

42 

13 

X 

14 

Median 

20 

50 

14.5 

85 

21 

45.5 

♦Class  groups  marked  (x)  were  reported  without  indication  of  size. 
fSupervised  study.     Approximate  results. 

Table  14  and  Figure  7  show  the  per  cent  the  study  hall  cost 
is  of  the  actual  instructional  cost,  and  the  average  size  of  the 
study  hall  groups  so  far  as  reports  were  complete.  The  study  cost 
percentage  increases  in  no  marked  degree  from  the  larger  to  the 
smaller  schools,  being  20,  14.5,  and  21,  respectively,  for  the  schools 
of  Groups  I,  II,  and  III.  There  are  also  great  variations  within 
the  schools  of  any  one  group.  For  example,  the  schools  of  Group 
II  show  a  variation  from  10  to  23  per  cent  and  in  Group  III 
from  0  to  29  per  cent.  Several  schools  of  Group  III  report  no 
assembly  study  groups.  As  the  normal  pupil  carries  4  subjects 
daily,  and  as  the  usual  program  has  7  or  8  daily  periods,  it  is 
improbable  that  any  school  is  without  study  groups.  However, 
in  some  of  these  schools  these  study  groups  sit  in  rooms  where 
classes  are  reciting,  and  hence  the  teacher's  weekly  schedule  as 
reported  to  me  credits  the  teacher  with  a  recitation  class  and  not 
with  a  stutly  group.  Two  schools  of  Group  I,  one  having 
no    assembly    cost    and    the    other    having     but    4    per    cent, 
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arc  ()|)('rat  iti<i-  on  a  supervised  study  basis  and  the  time  has  been 

cluirj>;ed    directl}'    to    instruetioual    cost.      With  a    proper   (Hvision 

of    time    between    stud\'    and    recitation    these  figures    shouhl    be 
40  per  cent   and    1")  ])er  cent,  respecti\'ely. 


n 


M 


PERCENT    STUDY  HALL 
COST   IS  OF    IHST.COST 

Fi(i.  VI  I. 

Tlie  ])robh'ni  of  better  direction  of  study  is  receiving  much 
attention  among  high  school  administrators.  The  plan  generally 
in  vogue  at  the  present  time  of  large  assembly  groups  under  the 
direction  of  one  teacher,  who  is  present  for  the  maintenance  of 
order,  has  not  yielded  satisfactory  results.  The  plan  of  doul)ling 
the  time  of  the  usual  class  periods,  using  one-half  for  recitation 
and  the  other  one-half  for  su])ervised  study,  has  not  been  em- 
j)loyed  extensively  because  of  its  prohibitive  cost. 
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Table  14  indicates  that  ])reseut  ]H-actice  favors  study  j2;r<Hips 
of  from  55  to  60  pui)ils  each  in  schools  of  Group  I,  but  with  a 
range  of  variation  from  16  to  167.  Schools  of  Group  II  favor 
a  median  study  group  of  85  i)U])ils  with  a  variation  from  (il  to  135. 
Group  III  has  a  median  of  45  with  a  variation  from  80  to  77. 
Only  the  most  successful  teachers  are  able  to  keep  50  or  60  pupils 
at  effective  study;  and  in  large  groups  including  the  preparation 
of  many  subjects,  it  is  apparent  that  no  one  teacher  can  give  any 
effective  supervision  to  study  hall  work. 

In  my  judgment,  where  study  hall  cost  api)roximates  20 
per  cent  of  the  instructional  cost,  a  school  would  do  well  to 
seriously  consider  introducing  some  plan  of  effectively  directed 
study.  Instead  of  40-minute  periods  for  recitation  only,  60- 
minute  periods  could  be  substituted  for  combined  recitation  and 
study,  and  the  class  groups  could  be  increased  somewhat  in  size 
over  the  present  standards  in  most  of  the  schools  of  Groups  I  and 
II.  Under  the  present  plan  of  work,  teachers  in  Groups  I  and  II 
average  6  recitation  periods  a  day,  and  have  in  addition  one  period 
daily  assigned  to  study  hall  and  another  to  conferences  with 
pupils,  or  a  total  of  eight  periods  or  about  6  hours  a  day.  Under 
the  proposed  plan  each  teacher  would  have  not  to  exceed  6  1-hour 
periods  daily  with  assembly  and  conference  periods  eliminated. 
With  a  20  per  cent  increase  in  class  size  the  number  of  daily  classes 
could  be  decreased  to  5  witli  the  present  teaching  force.  It  seems 
possible  by  proper  administrative  readjustments  to  increase  the 
effectiveness  of  school  study  by  careful  direction  without  increasing 
the  burden  upon  the  teacher  or  increasing  the  burden  of  cost  to 
the  taxpayers.  The  high  school  at  Richmond,  Ind.,  has  been 
operating  on  a  65-minute  basis  during  the  present  year  without 
any  increase  in  cost.  The  instructional  and  study  cost  for  this 
school  is  exactly  the  median  for  schools  of  Group  I,  as  may  l)e 
seen  by  consulting  Table  1  or  Figure  3. 

It  may  be  found  on  trial  that  carefully  supervised  study  during 
the  ninth  and  tenth  years  will  be  sufficient  to  develop  good 
and  lasting  study  habits,  and  that  in  the  eleventh  and  twelfth 
years  pupils  may  do  satisfactory  work  in  large  assemlily  study 
groups  as  at  present.  The  Joliet  (111.)  township  high  school 
operates  on  this  basis. 

The  Program  of  Studies 

The  ordinary  school  program  shows  merely  what  subjects  are 
offered  and  gives  no  indication  of  the  number  of  credits  attempted 
in-  each  subject,  which  is  the  value  atta(;hed  to  these  subjects 
by  the  i)upil  or  community. 
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TABLE   15. — Vkh  Chnt  thk  Numher  ov  (Credits  in  Each   Dkpaht.mknt 
IS  OF  THE  Whole  Number  of  Credits  Attempted 
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5.8 

0 

14  7 
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16  1 
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11  0 
0 

9  1 
0 

3  0 
2  2 
3.6 
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.8 
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0 
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0 
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0 

3  3 

0 
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23.5 
26  0 
24.1 
24.0 
23  6 
26  3 
26.1 
23.7 
23.3 
23  7 
14.4 
22.7 
22.7 
25.3 


23.7 


25.4 
22.7 
24.6 
23.7 
30.8 
22.0 
21.6 
28.3 
21.8 
22.3 
28.5 
22.8 
29.7 


23.7 


7.6 

7.8 
12.3 

8.9 
18.4 

6.8 
10.8 


8.9 


7.0 
12.1 
12.8 
13.8 
12.9 
14  3 
11.5 
16.5 
11.9 
11.9 
15.9 
11.3 
11.9 
12.8 


12. 


10.6 
15.0 
15.8 
19.3 
21.2 
12.4 
14.9 
9 

12.9 
15.9 
11.1 
15.5 
15.5 


4.3 
2.5 
3.7 
4  1 
4.7 
5.6 
2.8 


2.3 
2.8 
4.8 
5.5 
5  7 
6.7 
6.1 
3.7 
3.9 
5.5 
2.8 
1.2 
4.4 
1.4 
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4.9 
6.3 
3  8 
5.8 
0 
8 

8.3 
11.8 
1.1 
2.9 
2.4 
1.4 
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12.9 
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9  3 
4  1 
5.3 


6.4 


7.9 
7.8 
11.6 
12.2 
10.4 
4.4 
13.6 
11.1 
7.7 
10.4 
7.5 
4.2 
14.0 
10.8 

10.4 
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9.5 
7.3 
16.0 
0 
0 
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13.3 
13.9 
17.9 
12.4 
4.2 
8.5 


10.1 
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2.4 
4.1 
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2.9 
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4  3 
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2 

4  5 
4  0 
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3.6 
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1.6 

0 
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0 

0 

0 

7.9 

1.2 

5.9 

1.9 

0 


1.6 


15.1 
18.6 
19.7 
19.8 
16.6 
16.0 
16.8 

16.8 


19.5 
21.4 
19.9 
19.2 
16.0 
17.6 
18.2 
19.3 
21.8 
15.6 
18.5 
10.6 
18.8 
19.8 


19.0 


14.4 
16.4 
18.3 
20.3 
10.1 
20.9 
15.5 
17.9 
21.8 
16.1 
12.4 
18.8 
19.0 


17.9 


7.8 
13.1 

9.4 
13.7 
11.7 
11.9 

8.4 


11.7 


13.9 
5.0 
5.2 
6.0 
4.2 

10.1 
6.2 

10.0 

12.5 
5.9 
9.6 
7.6 
9.1 

10.9 


8.3 


0 
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0 

1.5 
22.6 
14.2 

0 

0 

0 

0 
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11.3 


1.5 
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1.3 

0* 

0 

2.3 

1.1 
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3.6 

0 
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2.1 

1.9 

0 

0 
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2.4 
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1.0 

2.4 

1.9 


4.8 

4.7 

0 

0 

7.0 
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0 

15 

0 

4.5 

9.4 

3.9 

0 


3.9 


0 

2.4 

12 

0 

0 

4.7 
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0 

0 

0 

0 

1 

0 

3.6 

0 

0 

0 

0 

0 
0 


7.2 
13  7 
8  7 

10  4 

11  4 
8,1 
9.4 

9.4 


6  2 
6  4 
7.1 
11  9 
11  2 
14  3 
6  7 

10  6 
9  3 
5.7 

11  7 
16  8 

8.5 
9.9 

9.6 


23.1 

9.5 
12.5 

7.7 
11.2 
15.3 

4.1 
17.5 

4.0 
11.9 
13,8 
12.1 
13.2 


12.1 


♦School  4  of  Group  I  reported  music  after  all  the  tables  had  been  computed. 
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As  a  by-product  of  the  study  of  costs,  the  percentage  com- 
position of  the  program  of  study  has  l)een  computed,  leased 
on  the  number  of  credits  attempted  in  each  department.  Table 
15  and  Figure  VIII  show  the  r(>sults  by  schools,  groups,  andsubjects. 
With  the  exception  of  school  4  of  (Iroup  I,  wliich  made  a  sup- 
plementary report  on  music  too  late  to  include  in  this  studj', 
the  data  of  this  table  are  as  rei)orted  by  the  schools.     It  may 

PERCENT  OF  ALL  CREDITS*  ATTEMPTED 

\  1  13  4^5  6769)0^2    H    ib    ie>    ZO   22   24 

EN6. 
NI5T. 
li.yil?T 
LATIN 

mw, 

MU5IC   Nh.  — a)UP  I 

Tig.  VIII. 

be  that  some  chorus  work  rei)oitc<l  is  Riven  witliout  m-A\t   hut 
has  been  here  tal)ulated  as  .1   credit  for  every  full  time  pupil 

recitation  per  week. 

From  the  table  certain  facts  stand  (.ul  clearly:  first,  approxi- 
mately four  years  of  English  is  taken  if  not  required  (23.7  per 
cent  of  the  total  credits);  second,  physical  training,  which  is  of 
more  value  during  the  high  school  age  than  at  any  other  pcrioil  of 
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life,  is  a  ucj^lijiihlc  quantit>',  ha\iii,ti  a  percentage'  of  0  for  the  median 
in  (iroups  II  andlllaiid  hut  1.2  in  (Jroup  I;  (liii'd,  thatdrawing 
and  art  i-eccivc  loo  little  emphasis  to  realize  either  their  cultural 
or  \-ocatioual  \alues;  fourth,  that  the  so-called  i)re-vocational 
subjects  of  household  arts  and  manual  arts  have  not  \v\  usurpcnl 
to  any  considerable  degree  the  place  of  the  traditional  subjects. 
Latin  seems  to  be  giving  way  to  modei-n  language  in  the  larger 
schools  ((irou])  I),  but  it  has  a  distinct  lead  in  the  schools  of 
(Iroups  II  and  III.  Owing  to  the  peculiar  conditions  in  school  5 
of  (Ironp  111  (the  median  case  in  modern  language)  0.7  (the 
average)  should  be  substituted  for  l.odhe  median)  to  rein'csent 
a(le(|uatel>'  t  he  woi'k  a<  tempt  edin  t  his  subject.  The  gi'oup  medians 
for  commercial  work  i)robably  represent  a  reasonal)le  demand 
u])on  the  high  school  progi'am,  but  it  may  be  seriously  (luestionc d 
whether  a  lo  to  20  i)ei-  cent  allot  nu'ut  of  credits  to  this  subject  as 
repoi'ted  fi'om  se\-eral  schools  is  in  all  cases  a  proi)er  demand. 
Even  the  industrial  centers  need  lu)  such  proportion  of  workers 
trained  along  these  lines.  .\s  a  result,  we  are  making  these 
commercial  courses  a  preparation  for  the  blindest  of  blind  alley 
jol)s,  and  are  being  treated  to  the  spectacle  of  graduates  of  our 
high  school  commercial  courses  competing  for  84  a  week  jxjsitions. 
A  considerable  taking  of  certain  commercial  subjects  as  electives 
by  students  who  do  not  expect  to  enter  commei'cial  employment 
ma>'  be  justified  because  of  the  general  utilit>'  of  these  subjec^ts 
to  the  average  man. 

The  small  numbei-  of  failures  in  all  the  special  and  vocational 
sul)jects  in  most  schools  gives  I'ise  to  a  suspicion,  sometimes 
openly  expressed,  that  i\\v  p()})ulai"ity  of  these  courses  is  due  to 
the  ease  with  which  students  may  earn  their  credits  rather  than 
to  their  recognized  social  values. 

When  the  importance  of  the  social  and  natural  sciences  for 
modern  life  is  considered, the  attention  they  receive  in  ( !i-oupl  schools 
is  perhaj^s  too  little.  If  need  be  the  English  and  foreign  language 
departments  could  still  afford  to  suffer  a  slight  diminution  of  their 
glory  in  favor  of  these  subjects  which  have  as  great  cultural  and 
disciplinary  values,  and  greater  social  and  ])ractical  values  than 
the  foreign  languages. 

While  the  group  medians  represent  fairly  well-balanced  pro- 
grams, many  individual  schools  have  a  very  faulty  organization 
as  jutlged  by  these  median  standards.  This,  in  part,  cannot  be 
avoided  in  the  smaller  schools  where  only  a  limited  number  of 
subjects   can   be  offered   effectively.      However,   even   here  some 
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balance  should  be  maintained.  In  the  smaller  schools  one  foreign 
language  should  be  sufficient,  but  many  are  attempting  two, 
thereby  giving  undue  emphasis  to  the  language  work  and  at  the 
same  time  producing  a  high  cost  for  instruction  by  operating 
a  large  number  of  small  classes.  In  schools  of  Group  III  science, 
including  agriculture,  might  well  receive  15  or  20  per  cent  of  the 
credits  attempted. 

As  further  examples  of  lack  of  balance  in  the  program,  several 
illustrations  will  follow.  School  7  of  (Iroup  III  shows  33  per 
cent  of  its  credits  in  foreign  languages  and  but  4  per  cent  in 
science.  School  5  of  this  group  shows  about  50  per  cent  more 
credits  in  English  and  history  than  its  group  standard  and  double 
the  standard  in  music,  but  is  giving  language  instruction  to  but 
3  pupils,  which  represents  1.5  per  cent  of  all  the  credits  attempted 
by  the  school.  School  6  of  this  group  offers  no  work  in  one-half 
the  subjects  as  classified  in  this  report,  and  perhaps  wisely  so, 
but  it  is  doubtful  whether  so  much  stress  should  be  given  to 
foreign  language  and  music  rather  than  to  history  and  household 
arts.  As  this  school  is  below  the  group  median  in  costs,  it  might 
well  afford  to  extend  its  offerings  somewhat  in  departments  of 
work  not  now  offered.  School  5  of  Group  I  reported  no  offerings 
in  commercial,  drawing  and  art,  music,  or  physical  training. 
Cooperative  arrangement  with  local  commercial  colleges  might 
remove  the  need  for  offering  the  commercial  courses  in  the  high 
school,  but  in  a  school  of  this  size  all  these  departments  should 
be  represented  on  the  high  school  program.  The  natural  science 
column  shows  great  variability  in  all  three  groups,  which  indicates 
a  marked  lack  of  standardization  for  a  subject  which  has  so  long 
had  a  place  on  the  high  school  program. 

On  page  25  of  his  report  on  costs  in  Kansas  high  schools, 
Monroe  indicates  the  per  cent  of -teaching  time  devoted  to  each 
subject  of  the  program.  This  is  desirable  from  the  point  of  view 
of  costs,  but  it  affords  no  index  of  the  actual  credit  values  offered 
by  subjects,  which  is  the  information  desired  by  the  administrator 
in  reorganizing  his  program  of  studies.  The  medians  of  Table  15 
indicate  standards  of  curriculum  organization  in  Indiana  so  far 
as  we  may  be  said  to  have  developed  any  standards.  Fig.  VUl 
represents  graphically  these  median  standards. 

At  the  end  of  the  first  semester  supplementary  forms  were 
sent  out  to  ascertain  the  number  of  credits  attempted  in  each 
subject,  the  number  passed,  and  the  number  failed,  so  that  costs 
might  be  also  computed  on  the  basis  of  th(>  number  of  credits 
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piissecl,  ami  stuiulards  clctcrmiiied  for  failure  in  the  (liffcreiit  sub 
jects.  As  less  than  one-half  the  schools  made  this  report,  it  has 
been  impossible  to  treat  adequately  this  j)hase  of  the  investigation. 
This  inv(^sti<2;ation  has  ])(mmi  undertaken  not  to  disseminate  any 
l)redetermine(l  opinions  relative  to  high  school  costs  and  organiza- 
tion, but  has  been  entered  into  cooperatively  by  the  34  schools 
for  the  i)urp()se  of  gathering  essential  facts  concerning  high  school 
costs  and  organization  that  each  school  administrator  might 
have  comparative  data  by  which  to  ciieck  and  guide  his  own 
practice. 


The  Measurement  of  Achievement  in  Algebra 

Hubert  G.  Childs 

In  April,  1915,  the  research  committee  of  the  Indiana  High 
School  Principals'  Association  in  conference  with  the  writer 
decided  to  recommend  a  cooperative  study  in  testing  achievement 
in  algebra.  The  writer  assumed  responsibility  for  the  arrange- 
ment of  the  tests  and  the  tabulation  of  data.  Acknowledgements 
are  due  to  Mr.  J.  Z.  A.  McCaughan  of  the  Bloomington  high 
school  for  assistance  in  the  selection  of  the  tests  and  determination 
of  their  preliminary  arrangement. 

A  series  of  twelve  tests  was  arranged,  based  largely  on  the 
Monroe  tests  which  had  been  used  in  the  schools  of  Kansas  during 
the  year.  The  Monroe  tests  were  added  to  by  the  inclusion  of 
tests  in  formal  subtraction  of  polynomials  (Test  I),  long  division 
(Test  IV),  easy  and  difficult  problems  to  be  stated  in  the  form 
of  equations  (Tests  VII  and  XII),  factoring  (Test  X),  and  solving 
simultaneous  linear  equations  (Test  XI).  Test  B  of  the  Monroe 
series  was  slightly  modified,  and  calls  for  the  clearing  of  fractional 
equations  of  fractions  (Test  VIII).  The  following  samples 
indicate  the  type  of  problems  used  in  each  of  the  tests.  Where 
the  problems  of  any  test  were  recognized  to  be  of  unequal  difficulty, 
the  more  difficult  forms  were  introduced  at  regular  intervals  so 
as  to  have  the  results  comparable  whether  a  pupil  completed 
3  or  4  or  10  or  12  exercises  in  a  given  test. 

Test  I.     Subtract.     Time,  2  minutes. 
10a  -  17b  +  240 
-3a  +    2b  -  100 


Test  11.     Multiply  and  remove  parenthesis.     Time,  1  miiuit(\ 

±  4  (±  3x  ±  7) 

Test  111.     Solve  for  x.     Time,  1  minute. 
±  15x  =   ±  4. 

Test  IV.     Divide.     Time,  6  minutes. 


3x  -  2|  -  3x2  +  i7x  _  10 

(171) 
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Test  V.      Transpose  terms.      Time.  1   mimile. 
_  4x  +  5   =  -Ax   -  9 

Test  VI.      Collect  terms.     Time.  2  minutes. 

-  r>A\   -   10   -   llo   -  40.\   = 

Test  V'll.     State  as  an  equation.      Time,   1  minutes. 

The  sum  of  two  miinhers  is  1(11).     The  greater  is  I'our  times  the  lesy 
Find  (;aeh  numher. 

Test  VIII.      Clear  of  fractions.      Time,  'A  minutes. 

-  7.\   -  2        .X  +  1 

6  S 

Test    I.\.      Solve  for  X.      Time.   10  minutes. 
;!.x    -    2        X    +    2 


'I\'sl   .\.      Factor.      Titne,  2  minutes. 

X-   —  2x   —  24  (li\c  type  forms  <;i\cn). 

Test  XI.      Sohc  for  hoth  unknowns.      Time,  .',  minute-. 
7.x   -Ay   =   12 
Sx    -  r,y    =  0 

Test   XII.      State  as  an  ('(piation.     Time.  10  mimites. 

The  lens'  (Uiih  of  a  numher,  ex|)resse(l  hy  two  difjits,  is  three  times 
the  units'  difjit.  If  the  number,  diminished  by  '.VA.  is  di\ided  by  the 
differene*"  of  the  di^'its,  the  (piotient  is  10.     What  is  the  numt)er"' 

In  many  respects  these  tests  lack  many  of  the  characteristics 
of  highly  scientific  tests.  For  exain])le,  the  relative  vahies  ot  the 
(lift'erent  types  of  processes  have  not  Ijeen  determined,  nor  are 
all  the  examjiles  unde.'  any  one  test  of  ecjual  difficulty,  nor  do  the 
examples  under  any  one  test  form  a  graded  series  of  steps  of  known 
difference  of  difficulty.  All  these  defects  are  also  apparent  in  the 
tests  of  Thorndike,  Monro(%  and  Rugg.  However,  these  tests 
have  accomplished  in  part  the  immediate  purpose  of  the  co- 
operators,  namely,  the  determination  of  a  norm  of  achievement 
of  certain  types  in  first  year  algebra  in  Indiana  high  schools, 
within  the  limits  of  the  tests  and  the  small  number  of  schools 
cooperating. 

A  uniform  set  of  directions  was  sent  out  to  each  school  giving 
the  tests,  and  the  tests  were  given  in  the  several  schools  within 
two  weeks  of  the  completion  of  the  term's  work.    The  results  show^ 
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the  usual  wide  range  of  variation  between  scliools  and  between 
pupils  of  the  same  school  and  class. 

Some  teachers  may  object  that  these  tests  do  not  represent 
a  fair  measure  of  the  algebraic  ability  of  the  pupils  of  a  given 
school,  since  not  all  the  processes  tested  are  deemed  of  ("(jual 
worth  by  all  teachers  and  hence  have  not  received  equal  emphasis 
and  drill,  while  others  more  emphasized  by  some  have  been 
omitted.  This  objection  is  true  in  part,  but  such  processes  as. 
are  represented  by  Tests  II,  III,  V,  VI,  VII,  IX,  and  X  are 
generally  considered  important  and  should  receive  such  emphasis 
as  to  render  these  processes  automatic  and  accurate  at  the  hands 
of  the  pupils. 

One  objection  to  the  tests  as  arranged  is  that  tlu^  time  reciuired 
for  their  administration  is  too  long.  From  this  point  of  view  the 
number  of  tests  should  be  reduced  to  7  or  8  thru  the  elimination 
of  some  and  the  combination  of  others.  All  possible  processes 
cannot  be  tested  in  a  general  comparative  test,  but  only  a  few 
of  the  most  characteristic.  In  the  interest  of  time  economy 
the  writer  recommends  the  use  of  the  following  tests  only  for  those 
schools  wishing  to  compare  their  algebraic  achievement  with  the 
norms  indicated  in  this  study:  Tests  II,  III,  V,  VI,  VII,  IX,  and 
X.  These  tests  can  be  administered  within  the  time  limits  of  the 
usual  classroom  period  of  40  minutes. 

Ten  schools,  including  435  pupils,  contributed  to  the  results 
for  the  first  semester's  work  in  algebra  and  5  of  these  with  5 
others,  367  pupils,  contributed  the  data  showing  the  achievement 
at  the  completion  of  a  full  year's  work.  Several  other  schools 
have  given  the  tests  but  they  have  failed  to  contribute  their 
data  to  this  cooperative  study. 

The  writer  has  thought  it  best  to  reduce  tjie  results  for  each 
test  to  terms  of  achievement  (attempts  and  rights)  i)er  minute 
as  affording  a  better  basis  for  the  comparison  of  test  with  test 
and  for  summarizing  the  average  achievement  in  several  tests 
combined. 
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TABLE    r. — AciiiKvioMENT  IN  First  Sf.mkstimi  ALciiOBUA 
Stated  in  terms  of  achievemeut  per  minute 


Test  I 

Test  II 

Test  III 

No.  of  Sol 1 

D. 

a 

5 

< 

§ 

J3 
S 

03 
-< 

o 
O 

a. 

a 
< 

s 

>, 

3 

"a 

i 

o 
O 

1 

3.35 
3.85 
4.05 
2. 05 
2.30 
3.55 
4.30 
3.20 
4.20 
3.90 

.75 
2  75 
1.05 

.  05 

70 
1 ,  55 
2  70 
1.50 
1 .  30 
2,75 

22 
72 
41 
IS 
30 
44 
03 
47 
31 
71 

17- 
198 

68- 

12- 

21 

68 
170 

71- 

41- 
196- 

6.50 
7.60 
7.60 
8.30 
8.60 
7.30 
8.10 
7.60 
7.90 
7.50 

5.00 
6.90 
6.50 
7.60 
5.00 
5.90 
7.20 
7.20 
6.70 
6.30 

77 
91 
86 
92 
58 
81 
88 
93 
85 
84 

385 
628 
559 
699 
290 
478 
634 
660 
570 
529 

6.90 
8.60 
7.80 
5.60 
6.50 
6.90 
9.10 
9.40 
6.50 
7.00 

3.00 
6.70 
3.10 
2.60 
1.50 
3.30 
8.20 
8.30 
3.30 
4.00 

43 

78 
46 
46 
23 
48 
90 
88 
51 
57 

129 

2 

523 

3 

194 

4 

120 
35 
158 
738 
730 
168 

8 

9 

10 

13 

15 

228 

1.52 

46 

70 

6.60 

86 

565 

3.30 

50 

163 

High        

2.75 

72 

198 

7.60 

92 

699 

8.20 

90 

738 

Low 

.65 

18 

12- 

5.00 

58 

290 

1.50 

23 

35 

Hatiii  Ilitili  to  Low. 

17-1 

2i-l 

21-1 

Tivst  IV 

Tci, 

t  V 

Test  VI 

Nuiiilicr  of  Scliool 

a 

S 

3 

5 
1 

a 

'£. 

>. 

a 

3 

SE 

a 

3 

3 

a 

< 

w 

< 

a 

< 

3i 

-f. 

o 

< 

s 

<(•, 

O 

1 

.88 
.80 
.88 
1.38 
1.12 
.82 
.87 
.67 
.75 
.90 

.29 
.38 
.40 
.45 
.20 
.35 
.48 
.38 
.45 
.42 

26 
48 
45 
33 
18 
43 
56 
58 
60 
47 

6 

18+ 
18 
16 

4- 
15 
27 
22+ 
27 
20- 

4.70 
4.80 
5.90 
5.40 
4.50 
4.70 
6.20 
5.00 
5.20 
4.30 

3.5; 
3.60 
4.70 
4.80 
1  30 
4.30 
5.90 
4.60 
4.40 
2.50 

74 
83 
80 
89 
29 
92 
95 
92 
85 
58 

259 
299 
376 
429 
38 
390 
.561 
423 
374 
145 

2.95 
3.40 
3.20 
S.75 
3.00 
3.90 
4.20 
3.45 
3.05 
4.00 

1.95 
2.40 
2.05 
2.65 
1.60 
1.90 
3.40 
2.85 
2.00 
3.00 

49 
71 
65 
71 
53 
49 
81 
83 
66 
75 

71 

2 

3 

171- 
134 

4 

5 

188 
85 

8 

93 

9 

10 

276- 
237 

13 

132 

15 

225 

Medians 

.39 

47 

18 

4.50 

83 

375 

2.22 

68 

152 

High 

.45 

60 

27 

4.80 

89 

429 

3.40 

81 

276 

Low  .     ... 

.20 

18 

4- 

1.30 

29 

38 

1.95 

49 

71 

Ratio  of  High  to  Low. 

7-1 

11-1 

4-1 
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Test  VII 

Test  VIII 

Trst 

l.\ 

Number  of  School 

§ 

^ 

M 

s 

o 
O 

t 

c 

g 
o 

1 

1 

1 

S 

< 

O 

1 

1.65 
1.52 
1.35 
1.62 
1.30 
1.62 
1.69 
1.55 
1.22 
1.50 

1.10 
1.20 

.60 
1.15 

.82 
1.05 
1.12 
1.32 

.80 
1.12 

67 
79 
44 
71 
63 
65 
67 
86 
65 
75 

74- 
95- 
27- 
82 
52 
68+ 
76- 
114 
52 
85- 

0 

1.27 
1.60 
2.26 
.43 
.43 
1.87 

0 
.43 
.83 

0 
.20 
.53 

0 
27 
37 

0 
14 
29 

0 

12- 
31 

0 

3- 
15+ 

3       

.56 
.88 
.15 
.53 
.73 

.16 

.26 

0 

.08 
.18 

29 
31 

0 
15 
25 

5- 

4 

8 

5  

0 

8     

1  + 

0          

a 

10 

13 

15       

1.57 

.20 

13 

3- 

.45 

.09 

20 

2- 

1.10 

67 

75- 

.20 

14 

3- 

.14 

22 

3+ 

High                 

1,32 

86 

114 

.83 

37 

31 

.26 

31 

8 

.60 

44 

27- 

0 

0 

0 

0 

0 

0 

3-1 

X 

X 

Test  X 

Averag 

e  of  First  Seven  Tests 

Number  of  School 

D. 

s 
< 

(5 

a 

o 
O 

a 
g 

< 

J3 
S 

3 

a 

6 

Rauk  First  t 
Seven 

1 

2.00 
2.80 
2.90 
2.85 
1.65 
1.10 
2.90 
2.20 
2.25 
2.70 

1.40 
2.00 
1.50 
1.90 
.85 
.40 
2.10 
1.90 
1.60 
1.75 

70 
71 
52 
67 
51 
36 
73 
86 
71 
65 

98 
142 

78 
128- 

44 

15- 
154- 
164- 
114- 
114 

3.85 
4.29 
.70 
4.24 
3.90 
4  11 
4.92 
4.41 
3.95 
4.16 

2.22 
3.42 
2.71 
2.84 
1.59 
2.62 
4.14 
3.73 
2.71 
2.87 

58 
80 
58 
67 
41 
64 
84 
85 
69 
69 

128 
272 
157 
190 
65 
167 
348 
317 
186 
198 

9,   - 
3.   + 

3 

8,   Av. 

4 

5,   Av. 

5            

10,    - 

8 

7,   Av. 

9  

1,   + 

10        

2,   + 

13                           : 

6,   Av. 

15                                  

4,   Av. 

1.68 

68 

114 

2.77 

68 

188 

1.90 

86 

164 

4.14 

84 

348 

.40 

36 

15- 

1.59 

41 

65 

• 

11-1 

5-1 

*Data  incomplete  for  Test  X.  Esoimate  based  on  relative  achievement  in  tlie 
first  seven  tests. 

t  '  +  ",  "Av.",  "-",  mean  decidedly  above  average,  average,  decidedly  below 
average,  respectively. 
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TAHLK   2.  —  A([iii;vi;mi;\t   in    Fiitsr   ^'l•:.\K   Al(:f.hi£a 


Staled  in  twins  of  acliifN cinciil   pcf  iniiuilo 


NuiiiIkt  1)1'  Scliool 


Test  I 

Tft, 

t  11 

' 

Test 

III 

-2 

>•, 

S 

i£ 

>j 

flj 

-2 

>, 

o. 
S 

£ 

3 

SE 

9 

S 

a 

si 

1 

^ 

£ 

3 

<: 

s 

<; 

o 

< 

5 

-t; 

o 

<t: 

« 

-»; 

., 

4  05 
4  05 
3  60 
3  50 
3  85 
3.25 
3  (iO 
3  50 
3.35 
3  90 

2.50 
2  25 
1  40 
1.75 
75 
1  60 
1  20 
1 .  15 
1.60 
2.40 

62 
56 
3<) 
50 
2) 
41) 
33 
33 
48 
62 

1.55 

126 

55 

88 

15 

79 

•   40 

38 

77 

149 

8,60 
9.10 
7  10 
5.40 
8.20 
6.70 
6  30 
8.90 
7.50 
7.80 

7  60 
6.80 
7.00 
4  30 
7.40 
6.30 
4.80 
7.90 
7.10 
7.20 

89 
74 
98 
79 
90 
92 
76 
89 
95 
92 

676 
503 
686 
340 
666 
580 
365 
703 
675 
662 

10  7 
9.50 
8.80 
5.10 

10  7 
6  30 
9.00 

10.3 
8.20 

11.1 

10  3 
5.,W 

5  40 
90 

6  20 
1  .50 
6.00 
6  .50 
6.10 

10  3 

96 
58 
62 
17 
58 
24 
67 
63 
74 
93 

!IN9 

4 

6 

7 

319 

335 

15 

S 

11 

tl2 

13 

.360 

36 

402 

no 

14 

451 

15 

95S 

Medians 

1.60 

49 

79 

7.30 

91 

664 

6  10 

63 

384 

High  

2  50 

62 

155 

7  90 

89 

703 

10.3 

96 

989 

Low 

"    "' 

•'0 

15 

4.30 

79 

340 

.90 

17 

15 

Ratio  of  High  to  Low 

10-1 

2-1 

66-1 

Test  IV 

Test  V 

Test  VI 

Numbor  of  School 

1 

« 

1 

6 

1 

s 

53 

3 

g 
< 

S 

< 

o 

0 

.93 

1.22 
.80 
.68 

93 
.80 

60 
.82 
.80 
.88 

55 
.32 
.38 
.38 
,47 
.55 
.30 
.40 
.42 
,47 

59 
26 
48 
56 
50 
(J9 
50 
49 
52 
53 

33 

8 
18 

22- 
23+ 
38 
15 

20- 
22 
25- 

6  10 
5.90 
5.10 
4  90 
6.20 
4. 30 
4  40 
5.50 
5.20 
5,80 

5  20 
4.70 

4  30 
4.10 
5,80 
3.70 

3  40 

5  0 

4  90 
4,40 

84 
80 
84 
84 
94 
86 
77 
91 
94 
76 

437 
376 
361 
.344 
513 
318 
262 
455 
461 
334 

4.25 
4.25 
3.75 
3,40 
3.80 
3.00 
2.85 
3.90 
4.20 
3.65 

3  .35 
2  60 
2.60 

2  10 
2,60 
2,30 
1  75 
2,90 

3  65 
3  05 

79 
61 

69 
62 

68 
77 
61 
74 
87 
83 

1.59 

4 

265 

6 

1,S0 

130 

8 

177 

11 

177 

12.. 

107 

13 

215 

14 

318 

15..  .   . 

253 

Medians 

,42 

52 

22- 

4  50 

82 

368 

2.60 

69 

178 

High 

55 

69 

38 

5.80 

94 

513 

3  65 

87 

318 

.32 

26 

8 

3.40 

77 

262 

1  75 

61 

107 

Ratio  of  HiKii  to  Low 

5-1 

2-1 

3-1 
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Test  VII 

Test  VIII 

Tost  IX 

Numl)cr  of  School 

Q. 
i 

< 

.2 

i 

o 

O 

n. 
1 

< 

cm 

(5 

>> 

i 

a 

a. 

a 
■5 

5 

>> 
a 

1 
c3 

•> 

1.45 
2.02 
1.50 
1.62 
1.68 
1.40 
1.58 
1.52 
1.82 
1.60 

1.08 

1.40 

1.08 

.89 

1.38 

.62 

.88 

.92 

1.35 

1.18 

74 
69 
71 
54 
82 
45 
56 
61 
74 
73 

80 

97 

76 

47 
113 

28 

49 

57- 
100 

86 

2.17 
2.93 
1.83 
1.83 
1.63 

1.17 
.93 
.93 
.30 
.73 

.54 
31 
50 
16 
45 

63 
29 

47 
5- 
33 

.70 

.88 
.68 
.62 
.59 

.38 
.35 
.23 
.15 
.24 

55 
40 
33 
24 
41 

21 

4 

6... 

7.. 

S 

11 

12 

13 
14 
15                     

14 

8- 
4- 
10- 

.77 
1.57 
1.73 
1.97 

.20 
.77 
.63 
.80 

26 
49 
37 

42 

5+ 
38- 
23 
34 

.46 
.43 

.70 
.78 

.13 

.22 
.26 
.46 

27 
51 
37 
59 

35 

11+ 
10- 
27 

1.08 

73 

78 

.73 

45 

33 

.24 

41 

10- 

High  

1.38 

82 

113 

1.17 

54 

63 

.46 

59 

27 

.62 

45 

28 

.30 

16 

5- 

.13 

27 

3,^ 

Ratio  of  High  to  Low 

4-1 

13-1 

8-1 

Test  X 

Test  XI 

Test  XII 

Number  of  School 

c. 
B 

< 

s 

< 

SB 

o 

a 

a 

>, 

3 
< 

o 
O 

p. 

i 
< 

s 

>> 

3 
< 

■a 

i 

2 

2.30 
3.75 
3.15 
2.90 
2.80 

2.05 
2.05 
3.00 
2.40 
2.65 

89 
55 
95 
82 
95 

183 
113 

285 
197 
252 

.84 
1.26 

.48 
.76 

59 
60 

28 
46- 

.40 

.78 

.08 
.21 

20 
27 

2  — 

4 

6- 

7 

8 

.92 

.48 

52 

25 

.61 

.08 

13 

1 

1.45 
2.65 
2.80 
3.10 

.70 
1.90 
2.45 
2.75 

48 
72 
92 
89 

34- 
137 
226 
245 

1  ."',                                 

.88 

.24 

27 

6+ 

.31 

.08 

26 

2+ 

11 

15   

.86 

.46 

53 

24+ 

.39 

.13 

33 

4+ 

2.40 

82 

197 

.48 

52 

25 

IIS 

-li 

2+ 

High      

3.00 

95 

285 

.76 

60 

46- 

.21 

- 

6— 



.70 

48 

34- 

.24 

27 

6+ 

OS 

13 

1 

8-1 

8-1 

6-1 

= 
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A 

vcrage 

Ml  Test 

s 

Average  First  Ten  Tests 

Average  First  Seven 

Tests 

llaiik 

Nuinlier  of 
School 

1 
< 

s 

g 

o 

S 
< 

5 

1 

o 
O 

Q. 
1 

s 

3 

si 
o 

1  irst 
Seven 
Tests* 

2 

4 

6 

3.54 
3.80 

2.89 
2.32 

81 
01 

235 
142 

4.12 
4.36 
3.03 
3.00 
4.04 

3.42 
2.69 
2.63 
1.73 

2.82 

83 
62 
72 
58 
70 

283 
166 
190 
100 
196 

5.15 
5.15 
4.38 
3.51 
5.05 
3.68 
4.05 
4.92 
4.44 
4.96 

4.37 
3.38 
3.16 
2.06 
3.51 
2.37 
2.62 
3.54 
3.59 
4.13 

85 
66 
72 
59 
70 
65 
65 
72 
81 
83 

371 
223 
227 
121 
245 
154 
170 
255 
290 
343 

1,    + 
7,  Av. 
6,  Av. 

10,   - 

8 

11 

3.49 

2.40 

09 

165 

5,  Av. 
0,   - 

12 

3.10 
3.91 
3.63 
4.06 

1.94 
2.77 
2.85 
3.29 

63 
71 

78 
81 

122 
197 
222 
267 

8,    - 

13 

14 

3.36 

2.33 

69 

161 

4,Av. 
3,    + 

15 

3  49 

2.79 

80 

223 

2,   + 

2.40 

69 

165 

2.82 

70 

196 

3.33 

71 

236 

High 

2.89 

81 

235 

3.42 

83 

283 

4.37 

85 

371 

2.32 

61 

142 

1.73 

58 

100 

2.06 

59 

121 

Ratio  of  High 

2-1 

3-1 

3-1 

*"  +  ".  "Av.",  and  " — ",  mean  decidedly  above  average,  average,  and  decidedl.v 
below  average  respectively. 

"t"  means  data  iiK-oini>lete  for  Test  f.  lOstiinalc^  ))ased  on  relativi^  achiev(!nieiit 
in  t 111!  other  tests. 


Explanation  and  iNTEuruKTATio.N  of  thk  Taules 

The  15  schools  coulrihutiiis  t<J  this  study  have  each  hccii 
designated  by  a  iiuiiibcr  at  the  h'ft  uikU'I-  the  heading  "No.  of 
School". 

Table  1  should  be  read  as  follows:  first  term  algebra  pu})ils 
in  school  No.  13  averaged  4.2  exani])les  attempted  in  Test  I; 
1.3  examples  right;  31  per  cent  accuracy;  and  made  an  (efficiency 
coefficient  of  41,  in  an  average  time  of  1  minute. 

As  the  number  of  examples  worked  right  in  a  given  time 
combined  with  the  per  cent  of  accuracy  determines  the  efficiency 
of  the  pupil  or  the  school,  the  writer  has  taken  the  product  of  these 
two  factors  as  a  measure  of  efficiency  of  achievement  thruout  this 
study.  While  the  writer  is  not  sure  that  this  index  is  the  most 
reliable  one,  it  has  the  value  of  giving  weight  to  both  the  under- 
lying factors,  tho  perhaps  not  in  the  most  desirable  proportions. 
It  also  affords  a  single  term  expression  in  which  to  compare 
individual  or  school  achievement.     Reference  to  the  ratio  of  high 
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to  low  records  in  the  tables  will  carry  conviction  that  this  co- 
efficient as  a  C()ni])arative  measure  has  not  done  vioh'iice  to  the 
situation.  For  exanii)le,  in  Table  2  under  Test  II  the  hiji;h  score 
of  7.9  right  and  89  per  cent  accuracy  is,  no  (l()id)t,  twice  as 
efficient  a  record  as  the  low  score  of  4.3  right  and  74  per  cent 
accuracy.  Reference  to  Test  III  of  the  same  table  would  seem 
to  warrant  the  conclusion  that  if  one  school  can  secure  a  result 
of  10.3  rights  and  96  per  cent  accuracy,  the  low  score  of  .9  rights 
and  17  per  cent  accuracy  is  worth  almost  nothing  and  may 
reasonably  be  considered  to  be  only  l-Gt)  as  efTicicnt  a  piec(^ 
of  work. 

Medians  in  these  tables  have  been  computed  fi'om  these 
efficiency  coefficients,  and  the  medians  for  "rights"  and  "accuracy" 
are  the  "rights"  and  "accuracy"  which  accompany  the  median 
coefficient. 

As  measured  by  these  coefficients  the  10  schools  tested  in 
Table  2  have  relative  efficiencies  varying  from  2)^  to  1  in  Test 
II,  to  21  to  1  in  Test  III,  and  with  a  ratio  between  high  and  low 
of  5  to  1  for  the  first  7  tests  combined.  The  ratios  of  efficiency 
in  Table  2  vary  from  66  to  1  in  Test  III  to  2  to  1  in  Tests  II  and 
V,  with  a  ratio  of  3  to  1  for  the  first  seven  tests  combined. 

In  fairness  to  some  of  the  schools  represented,  it  should  be 
stated  that  because  of  the  small  number  of  pupils  tested  in  some 
cases  (but  10  in  school  No.  7)  the  results  may  be  somewhat  erratic 
and  not  fairly  represent  the  ciuality  of  achievement  ordinarily 
secured  in  these  schools. 

By  comparing  its  efficiency  coefficient  for  each  test  with  the 
median,  and  by  noting  in  how  many  tests  it  exceeds,  is  equal  to,  or 
below  the  median,  any  school  can  determine  its  approximate 
rating  with  respect  to  the  others.  The  last  column  in  each  table 
shows  the  relative  ratings  of  each  of  the  schools  for  average 
achievement  in  the  first  7  tests  combined.    An  inspection  of  Table 

1  shows  that  school  1  is  below  the  median  in  7  of  the  8  tests  taken 
and  is  about  average  in  Test  VII,  while  school  10  is  above  the 
median  in  every  one  of  the  8  tests  taken.     The  rankings  of  these 

2  schools  for  the  first  7  tests  combined  are  ninth  and  second, 
respectively.  School  13  is  about  average  in  4  tests,  is  above 
average  in  2,  and  below  average  in  2,  or,  on  the  Avhole,  is  about 
an  average  school  in  algebraic  achievement. 

The  average  achievement  per  minute  for  first  semester  pupils 
for  the  first  7  tests  combined  is  rights  2.77,  accuracy  .68,  and 
efficiency  coefficient  188.     For  pupils  at  the  end  of  the  first  year 
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in  alj2;<^'l>i"a  tluM'orrespoiulinj;- fiji;ures  urc  3.38,  .71,  and  23G  respec- 
tively. This  repres(>nts  a  ^ain  (liirin<>;  the  second  half-year  of  about 
2()  ])er  cent  in  the  more  fundamental  ])i'ocesses  taken  up  in  the 
first  term.  The  per  cent  of  <>;ain  in  the  more  diflicult  processes 
which  receive  chief  em])hasis  during  the  second  sem(\ster,  iiow- 
ever,  is  hut  sliji;htl>'  "^I'eater. 

Tabh^s  1  and  2  show  vast  differences  in  achievement  in  the 
various  tests  for  the  same  time  hmit.  This  is,  no  doubt,  due  to 
two  factors:  first,  rehitive  difhculty  or  differeiu-es  in  the  number  of 
l)rocess(»s  involved;  and,  second,  the  j2;i''''ift'r  amount  of  drill  <>;iven 
to  certain  tyi)es  of  ])rocesses  which  may  vary  in  a  marked  def^ree 
with  different  teachers.  As  an  exam])le  of  such  vai'iation,  Table  2 
shows  a  median  for  Test  II  of  7.3  rights  and  .91  accuracy,  while 
Test  XII  has  a  nu>dian  of  .08  riji;hts  and  .2()  accuracy  for  the 
same  time.  An  insjx'ction  of  the  tests  reveals  the  fact  that  Tests 
II,  III,  \  ,  \T,  and  X  re])resent  simpler  i)rocesses  and  forms  that 
commonly  r(>ceive  much  drill,  while  IV,  \TI,  \'III,  IX,  XI,  and  .\II 
represent  a  complexity  of  processes  or  reasoninji;  ability  in  which 
the  same  def>;ree  of  speed  and  accuracy  nuiy  not  be  ex))ected. 

To  answer  the  probh^n,  to  what  ext(Mit  the  poor  results  of  some 
of  th(>se  schools  ar(^  due  to  combininji;  poor  scores  in  unimportant, 
and  hence  unem])liasized,  ])rocesses  with  good  results  in  the  more 
important  ])rocesses,  certain  comparisons  between  two  schools 
of  high  achievement  and  tw^o  of  low  achievement  are  made  for 
each  of  the  first  7  tests  from  Table  2.  Schools  2  and  15  are  taken 
to  represent  high  and  7  and  11  low  achiev(Mnent.  An  inspection 
of  the  table  shows  that  school  2  scores  very  high  in  Tests  I  and 
III;  above  average  in  I\',  V,  and  \T;  and  average  in  II  and  VII. 
School  15,  very  liigh  in  I,  III,  and  VI;  and  average  in  II,  IV. 
V,  and  VII.  School  7  scores  v(>ry  low  in  II  and  III;  below  average 
in  \T  and  \TI;  and  average  in  I,  IV,  and  V.  School  11  scores 
very  low  in  III  and  VH;  below  average  in  V;  average  in  I,  II, 
and  VI;  and  very  high  in  IV  (one  of  the  least  important  ])ro- 
cesses).  With  the  exception  of  school  11  in  one  test  it  wdl  be 
observed  that  the  schools  ranked  high  are  average  or  high  in  all 
tests,  while  those  ranked  low  are  average  or  low  in  all.  If  we 
assume  that  the  native  algel)raic  ability  of  pupils  in  one  school 
is  probal)ly  ecpial  to  that  of  tliose  in  another,  we  must  clearly 
attribute  these  differences  in  achievement  to  differences  in  the 
(luality  and  effectiveness  of  the  instruction  in  the  different  schools. 

The  value  of  measuring  achievement  thru  cooperative  standard 
tests  should  lie  in  making  each  teacher  and  school  conscious  of 
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liis  or  its  shortcominj>;s  as  revealed  by  comparison  with  others, 
and  should  lead  to  careful  investigation  to  locate  the  source  of 
weakness,  and  should  further  lead  to  such  modification  of  sul)ject- 
matter  and  method  as  will  yield  more  efficient  results.  The 
standard  test  should  be  the  best  means  of  constructive  super- 
vision. 

Comparative  Results  in  Other  States  With  Similar  Tests 

Comparative  data  are  scarce.  The  tests  given  in  Illinois 
last  year  by  Mr.  Rugg  have  Test  I  similar  to  Test  II  of  this  series, 
Test  IV  similar  to  our  X,  and  VII  to  our  IX.  The  following 
comparison  shows  the  approximate  achievements,  the  Indiana 
results  being  reduced  to  an  average  in  place  of  the  median  to 
conform  to  Mr.  Rugg's  data: 


Number  o 

F   Test 

Indiana 

Illinois 

Rights 

Accuracy 

Rights 

Accuracy 

II 

IX 

6.64 

27 

2   22 

88% 
42% 
80% 

6 .  .36 

.2.3 

1.19 

77% 
.31% 

X 

53% 

It  will  l)e  noted  that  the  most  marked  difference  is  in  Test  X, 
which  deals  with  factoring.  This  difference  may  be  due  to  some 
difference  in  difficulty  of  the  two  tests  used,  but  a  cursory  in- 
spection of  the  two  reveals  no  marked  differences  of  difficulty. 

The  Monroe  tests  have  types  equivalent  to  our  II,  III,  \', 
VI,  IX,  and  VIII.  Mr.  Monroe's  results  have  Ijccmi  reduced  to 
the  median  per  minute  basis  in  this  comparison. 


Indiana 

Kansas 

Rights 

Accuracy 

Rights              Accuracy 

II 

7  3 

()   1 

91', 
63% 

7.65 
0   2 

90% 

Ill 

65% 

V 

4   5 

82% 

3   55 

76% 

VI 

1  OS           i           73% 

2   33 

67% 

VIII 

7;<           1           45% 

.67 

37% 

IX 

.24                    41'-; 

.2 

33% 
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The  most  marked  difference  in  this  comparison  is  in  Test  VI, 
collecting  terms,  which  is  clearly  to  our  disadvantaji;e.  The 
Indiana  results  are  somewhat  superior  in  Tests  V,  \TII,  and  IX. 

If  the  same  tests  were  used  and  tiie  same  conditions  observed 
in  their  administration,  we  should,  no  doubt,  find  the  schools 
of  different  States  securing  approximately  equal  results  in  algebra 
or  any  other  subject  in  which  achievenKMit  should  be  measured,  if 
a  large  number  of  schools  be  chosen. 

Most  Common  Errors  of  Pupils  in  Algebra 

Professor  Monroe  and  Mr.  Kugg  have  carefully  analyzed  the 
typical  errors  made  by  pupils  in  the  tests  given  by  them,  and  the 
results  of  the  two  investigations  are  so  nuich  in  agreement  that 
it  seems  unnecessary  to  make  a  similar  analysis  for  our  test  ])apers 
for  we  should,  no  doubt,  find  th(^  same  conditions. 

The  investigators,  named  above,  have  found  errors  in  the  use 
of  signs,  particularly  the  minus  sign,  to  be  the  most  jirolific  source 
of  inaccuracy.  This  applies  to  all  ty])es  of  ])rocesses  wlu^e  the 
minus  sign  is  used.  The  second  most  common  source  of  ei'ror 
was  inaccuracy  in  the  fundamental  jji'ocesses  of  acit  limetical 
com])utation;  the  third,  mistakes  in  copying  terms;  the  fourth, 
a  closely  related  factor,  the  omission  of  terms,  ]iarticularly  .r, 
the  unknown,  the  value  of  which  was  to  be  found.  Other  con- 
spicuous errors  were  th(>  leaving  of  results  in  incompleted  form, 
as  —  X  =  7,  and  an  inability  to  deal  adequately  with  fractional 
forms. 

Limitations    of    the    Investigation    in    Establishing    Com- 
parative Norms  of  Achievement  in  Algebra 

The  limitations  of  the  types  of  tests  used  and  the  selection 
of  exercises  to  make  up  each  test  have  been  referred  to  at  the 
beginning  of  this  article.  There  yet  remains  to  be  considered 
the  reliability  of  the  administration  of  the  tests  by  each  school 
and  the  accurate  recording  and  tabulation  of  results. 

The  writer  did  not  give  the  tests  in  person,  but  sent  out  uni- 
form directions  to  be  followed.  Under  the  circumstances  coaching 
for  the  test  might  have  been  possible  had  any  teacher  cooperating 
so  desired.  Personal  acquaintance  with  the  principals  of  the 
schools  concerned  and  with  many  of  the  teachers,  together  with 
the  results  reported,  give  no  ground  for  suspicion  in  this  respect. 
It  should  also  be  stated  that  each  school  scored  its  own  papers. 
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However,  as  a  check,  papers  were  called  for  from  three  schools 
and  inspected.  The  per  cent  of  errors  found  in  scoring  these 
papers  was  found  to  be  very  small,  and  of  such  a  nature  as  to  have 
no  appreciable  effect  upon  the  tabulated  returns  which  had 
previously  been  made.  The  writer  is  responsible  for  all  com- 
parative tabulations. 

Further  Investigation 

Further  investigation  is  to  be  made  to  ascertain  if  there  is 
agreement  among  algebra  teachers  as  to  what  six  or  eight  pro- 
cesses are  most  typical  and  significant  for  the  first  year  work. 
Following  this,  two  types  of  scales  are  contemplated:  one  con- 
taining several  problems  of  equal  difficulty  under  each  test  type, 
and  to  be  given  on  the  time  limit  basis  (the  present  series  of 
tests  revised),  the  second  to  consist  of  a  graded  series  of  problems 
of  three  or  four  levels  of  difficulty  under  each  test  type  and  to 
be  used  chiefly  for  diagnostic  purposes  in  analyzing  the  level  of 
achievement  of  each  pupil.  This  latter  type  of  test  has  marked 
advantages  as  a  basis  for  drill  exercises  in  every  important  and 
minor  process,  Mr.  Murray  Dalman,  of  the  Manual  Training 
high  school,  Indianapolis,  has  done  some  good  pioneer  work  in 
this  respect. 

In  conclusion,  the  writer  wishes  to  state  that  this  investigation 
was  undertaken  to  determine  tentative  norms  only  in  certain 
types  of  algebraic  achievement,  and  trusts  that  these  results  may 
be  of  soine  value  both  to  the  cooper ators  and  to  others  who  may 
care  to  make  comparative  tests.  The  achievement  of  the  best 
schools  is,  perhaps,  a  better  norm  to  work  toward  than  the  median 
results. 


A  Study  of  Enrollment,  Acceleration,    Retar- 
dation, and  Normalit\'  in  High  Schools 


IlriiKKT    (1.    C^IllLUS 


iii('iiil)ci-s  of  the  Indiana  Ili^h  School  Princi])als'  Association 
from  whom  nine  icphi  s  wci'c  rcccix-cch  S('i)arat('  forms  were 
used  for  |)romot(Mh  non-pi'diiolctl,  ami  withch'awn  pupils  to 
ascertain  whcthci-  any  sij>;iiificant  differences  would  he  ai)pareiit 
anionjz;  these  jiroups  with  respect  to  normality,  accelei-ation,  and 
retardation.  The  numlxM*  of  replies  is  too  limitecl  as  a  ))asis  for 
standards,  hut  the  data  as  herein  tahulated  may  he  suggestive 
of  ])ossihilities  of  comi)arison. 

The  4  cities  listed  undei'  (iron))  !  range  in  population  from 
7,()()()  to  :-5(), ()()(),  and  the  five  in  Croup  11  from  oOO  to  4, ()()(). 

The  data  were  taken  fi'om  the  school  records  of  the  first 
semestei'  of  the  year,  and  the  ages  were  recorded  as  for  .January  '.U . 
The  normal  age  for  the  ninth  grade  was  taken  as  15  years,  i.e. 
from  la  uj)  to  1(1.  The  high  school  grade  classification  was  de- 
termined as  follows:  ninth,  0  to  (i  credits,  inclusive;  tenth.  7  to 
14;  eleventh,  1  o  to  22;  twelfth,  2)^  to  )>!.  Pr'omotion,  non- 
])romotion,  ami  withdrawal  wei'c  determined  by  the  status  of  the 
P'.'.pil  at   the  close  of  the  semester  at   promotion  time. 


(lS4y 
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TABLE   1. — Percentage  Enkollment  of  Hniii  Sciiooi,   Pi'i>ii,s   nv  Sex 

AND  Grade 


GRADE  AND  SEX 

(iroup  and  School 

IX 

X 

XI 

XII 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

22.5 
11  7 
16.4 
21.8 

Boys 

Girls 

Total 

Group  I 

1 

31  5 
49.1 
38.0 
35.5 

24,6 
43.6 
34.9 
41.9 

27.6 
46.4 
36.4 
39.3 

27,1 
29,6 
27.8 
26.9 

30,8 
28,2 
36.7 
22.3 

29.1 
28.7 
32.2 
25.2 

23.7 
10.5 
17.6 
23.0 

21.4 
12.8 
15.2 
21.0 

17.5 
10.6 
16.7 
14.4 

23.2 
15.3 
13.4 
14.7 

19.3 
27.8 
11.8 
26.0 
17.5 

20  7 
13  0 
15.0 
14.5 

9 

3 

4 

Group  II 

1 

34.1 
44  4 
11.8 
39.0 
30.6 

33.3 
26.6 
35.3 
31.2 
38.6 

33.7 
35.1 
19.6 
34.6 
33.8 

36.6 
28.4 
44.1 
30.5 
38.8 

26.5 
22.8 
23,5 
28.6 
30.0 

30.6 
25.6 
37.3 
29.4 
35.2 

14  6 
16.0 
23.5 
22.1 
16.5 

21.1 
22.8 
29.4 
14.3 
14.0 

18.4 
19  5 
25.5 
17.6 
15.5 

14  6 
11  1 
20.6 
8.5 
14  1 

17.3 
19.5 
I"  6 
IS  4 
15.5 

2 

3   . 

4 

5 

Medians 

35.5 

34.9 

34.6 

29.6 

28.2 

29.4 

17.6 

21.0 

18.4 

14  4 

17.5 

17  3 

*Indiana 

36.1 

33.9 

35.0 

26.2 

26.4 

26  3 

20.8 

21.9 

21.4 

16  9 

17.7 

17.4 

*United  States 

42.8 

39.2 

40.8 

26.6 

26.8 

26.7 

17.8 

19.3 

18.7 

12.8 

14.7 

13.9 

"Report  of  U.  S.  Commissioner  of  Ediication.  1914,  Vol.  II,  p.  420. 


TABLE  2. — Percentage  of  Acceleration,  Retardation,  and  Normality 

BY  Groups 


STATUS 

Group 

Within  one 

and 

Accelerated 

Retarded 

Normal 

year  Normal 

School 

*Prom. 

NonP. 

Wdrl. 

Total 

Prom. 

NonP. 

Wdrl. 

Total 

Prom. 

NonP. 

Wdrl. 

Total 

Total 

Group  I 

1.     . 

45.7 

12.0 

30,9 

40.0 

36.4 

78.0 

69.3 

44.4 

17.9 

10.0 

4  9 

15.6 

72.4 

2.... 

14.8 

26.3 

3.7 

14.3 

58.8 

.52.6 

79.4 

62.3 

23.1 

21.0 

18.5 

23.0 

70  0 

3.... 

56.7 

17.9 

14.3 

49.0 

28.6 

64.3 

78.6 

35.8 

14.6 

17.9 

7  1 

14.5 

76.2 

4... 

60.1 

21.6 

42.9 

53.8 

21.6 

56.8 

28.6 

27.1 

18.2 

21.6 

28.6 

19.0 

90.7 

GroupII 

1..., 

57.0 

60  0 

66.7 

,53.1 

19.4 

,57,1 

0,0 

21.3 

23.9 

42,8 

33.3 

25.5 

86.8 

2. 

39.2 

50.0 

30.0 

38.7 

31.5 

0.0 

28.4 

30.0 

30.4 

50.0 

50.0 

30.6 

85.6 

3... 

45.6 

66.7 

0.0 

45.1 

21.7 

,13.3 

0.0 

21.5 

32.6 

0.0 

100. 

33.3 

76.5 

4.... 

37.6 

0.0 

0.0 

32.4 

43.6 

81.8 

87.5 

49.3 

18.8 

22.2 

12.5 

18.4 

75.8 

5... 

37.9 

50.0 

33.3 

37.3 

26.5 

25.0 

83.3 

28.8 

34.7 

25.0 

16.7 

33.8 

89.4 

Medians 

45.6 

21.6 

30.0 

40.0 

28.6 

56.8 

69.3 

30.0 

23.1 

21.6 

16.7 

23.0 

76.5 

♦Prom,  means  promoted;  Non-P.,  not  promoted;  Wdrl.,  withdrawal. 
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Tal)l('  1  should  be  read  as  follows:  In  school  No.  1  of  (Jroup  I, 
31.5  per  cent  of  all  boys  enrolled  are  in  the  ninth  ^rade;  24. G 
per  cent  of  the  girls;  and  27.6  per  cent  of  all  pupils. 

Table  2  should  be  read  thus:    In  school   No.   1    of  (irou])  I, 

45.7  per  cent  of  ])romoted  pupils  are  accelerates;  12  jier  cent  of 
non-promoted  pupils  are  accelerates;  30  per  cent  of  withdrawals; 
and  40  per  cent  of  all  pupils.  36.4  per  cent  of  promoted  i)ui)ils 
are  retarded;  78  per  cent  of  non-promoted  ])upils  are  retarded, 
etc. 

Table  1  indicates  that  the  median  for  these  nine  schools 
is  approximately  the  same  as  that  for  Indiana  as  a  whole.  The 
distribution  of  pupils  in  Indiana  schools  is  more  satisfactory 
than  in  high  schools  of  the  United  States  in  general  in  that  the 
])ercentage  is  liiglier  in  the  third  and  fourth  years  and  lower 
in  the  first  year,  thus  indicating  a  greater  holding  power.  School 
No.  2  of  (irouj)  I,  which  has  apparently  the  poorest  record  of  the 
nine,  is  undergoing  a  rapid  growth  in  attendance  (al)out  50  ])er 
cent  in  one  year),  which  accounts  for  the  large  enrollment  in  the 
ninth  grade  and  the  low  enrollment  in  the  twelfth  grade.  Here 
it  is  not  so  much  a  rapid  loss  at  the  upper  end  of  the  course 
as  it  is  a  rapid  growth  at  the  lower  end  that  causes  the  apparently 
poor  showing.  School  No.  1  of  (iroup  I  shows  a  remarkal)le 
holding  i)Ower,  which  may  in  ])art  be  ex])lained  by  the  fact  that  it 
is  in  a  college  town. 

The  original  data  collected  show  the  facts  for  each  grade  and 
for  boys  and  girls  separately  with  respect  to  acceleration  and  retarda- 
tion. It  should  be  mentioned  that  with  almost  no  excei:)tion  the  girls 
have  a  higher  per  cent  of  acceleration  and  a  lower  per  cent  of 
retardation  in  every  school  and  grade  than  the  boys.  This  in- 
dicates that  whether  we  have  consciously  designed  it  or  not  our 
schools  are  better  adaptetl  for  securing  the  progress  of  the  girls 
than  of  the  boys.  However,  the  status  of  the  pupil  in  the  high 
school  may  be  entirely  due  to  forces  operating  in  the  elementary 
school  and  not  to  the  high  school  conditions  at  all.  To  determine 
the  accelerating  or  retarding  influence  of  the  high  school  we  should 
need  the  progress  records  of  pupils  in  the  high  school. 

An  inspection  of  the  data  of  Table  2  shows  great  variations 
l)etween   schools   with   respect   to   the   same  factor;  for  example, 

14.8  per  cent  of  the  promoted  pupils  in  school  2  of  Group  I  are 
accelerates,  and  58.8  per  cent  are  retardates,  while  in  school  4 
of  the  same  group  60.1  per  cent  of  promoted  pupils  are  accelerates 
and  21.6  per  cent  retardates.     The  median  results  indicate  that 
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45.6  per  cent  of  promoted  pupils  are  accelerates  and  28.6  per 
cent  retardates.  This  record  is  much  better  than  that  usually 
found  in  the  elementary  school  and  is  no  doubt  due  to  the  fact 
that  the  majority  of  retardates  have  been  eliminated  on  reaching 
years  of  voluntary  attendance. 

It  will  be  noted  that  the  non-promoted  group  has  the  lowest 
per  cent  of  accelerates  and  the  withdrawals  the  highest  per  cent 
of  retardates.  These  data  suggest  a  close  relation  between  re- 
tardation and  non-promotion  and  withdrawal. 

The  table  shows  that  40  per  cent  of  all  high  school  pupils  are 
accelerates,  30  per  cent  are  retardates,  and  23  per  cent  are  normal. 
A  further  computation  of  data  indicates  that  76.5  per  cent  of  pupils 
are  within  one  year  of  normal. 


Per  Cent  of  Failures  in  High  Schools 


Hubert  (J.  ("hilus 


At  the  same  time  as  indicated  above,  blank  forms  were  s(Mit 
to  the  same  schools  asking  for  (hita  rchitivc  to  cnrolhnents,  re- 
peaters, wit  h(h-avvals,  number  remaininj;',  faihires,  and  jjroiiiotions 
l)y  sut)j('cts,  to  whicdi  the  same  scliools  resj)onded  and  two  addi- 
tional. Xos.  .")  and  6  of  Group  1,  both  of  the  25,000  jiopulation 
city  chiss. 

In  tliis  rc])ort  the  <i;r<)ui)  classification  is  the  same  as  above, 
and  medians  have  l)een  com])ut(Ml  for  eacii  j>;r(nii)  and  for  all 
eleven  schools  cond)ined. 

A  portion  of  the  data  has  l)een  sunnnariz(Ml  in  th(>  acconi])any- 
in<>;  tables  under  these  heads:  (1)  ])er  cent  of  failures  by  (lei)art- 
ments;  (2)  jx'r  cent  of  failures  by  years;  (3)  jx'r  cent  of  failures 
in  certain  first  year  subjects. 

From  each  of  tiiese  tables  it  will  be  observed  that  the  \)vr  cent 
of  failures  is  <;i'eater  in  every  case  in  the  schools  ol'  (Iroup  I. 
This  may  be  accounted  for  in  two  ways:  hrst.  the  close  personal 
contact  of  patrons  with  the  scdiools  in  the  small  communities 
leads  to  fewer  failures  as  a  means  of  av()idin<>;  friction  and  difficulty; 
and,  second,  the  small  size  of  classes  and  the  close  ])ersonal  contact 
of  ])ui)il  and  teaclier  in  these  smaller  schools  should  result  in  more 
individual  stimulation  and  direction  and  fewer  failures. 

Every  table  shows  a  great  excess  of  failures  of  boys  as  compared 
with  girls  in  nearly  all  schools,  grades,  and  subjects.  Even  in 
mathematics,  supposedly  a  boy's  subject,  the  girls  surpass  the 
l)oys  in  eight  schools,  equal  them  in  one,  and  have  a  higher  per 
cent  of  failures  in  but  two  schools  (Table  1 ).  In  Table  2.  the  total 
median  shows  11.1  per  cent  failure  for  boys,  5..')  for  girls,  and 
8.5  for  l)oth  combined.  Table  3  shows  that  only  about  one- 
fourth  as  many  girls  as  boys  fail  in  first  term  algebra,  one-half 
as  many  in  first  term  botany,  two-thirds  as  many  in  first  term 
English,  one-sixth  as  many  in  first  term  (ierman,  and  one-third 
as  many  in  first  term  Latin. 
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TABLE    1. — Pek    Cent    ok    Faih  kks    hv     1)i,i>autments    (All    Yeaks) 


DEPARTMENT 

(iroup  and  Sctuxil 

Eiiglisli 

Foreign  Language 

N 

atlu'inatics 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Group  I 

1 

22.0 
9.6 

7.H 
25.0 
23,7 

7.9 

8.6 
7.4 
2.7 
11.3 
14  5 
4.5 

14  5 

8.5 
5.1 
17.0 

18.7 
6.3 

20.3 
22.4 
22.5 
23.9 
38.7 
23  3 

7  0 
11.8 

4.3 

5  4 
30  1 

7.2 

12.7 
17.1 
11.6 
11.9 
33.7 
15.3 

21.8 
11.9 
21.1 
22.4 
25.7 
22.1 

11.9 
17.2 
19.3 
4.8 
15.9 
22.1 

16  4 

2 

3 

4 

5 

6 

13.9 
20.2 
13.2 
20.8 
22.1 

M 

15.8 

8.0 

11.5 

22.9 

7.1 

16.6 

21.9 

16.5 

18.3 

Group  II 

1 

2 

3 

4 

15  4 
5  1 
0  0 
9.6 

7.5 

0.0 
13 
0.0 
5.6 
5.6 

6.3 

3.2 
0.0 
7.3 
6.7 

42.4 
23.3 

4.5 
13.5 

5.7 

11.7 
6.2 
0.0 
5.6 
0.0 

23.8 
15  3 
2.8 
8.5 
3.0 

20.0 
14.5 
23.0 
13.0 
8.6 

0.0 
6.9 
9.9 
6.7 
10.0 

9.6 
10.6 
18.1 

9  9 

9.2 

M.    . 

7.5 

1.3 

6.3 

13.5 

5.6 

8.5 

14.5 

6.9 

9.9 

9.6 

5.6 

6.7 

22  5 

6.2 

12  7 

21.1 

10.0 

13.9 

TABLE  1— Continued. 


DEPARTMENT 

Practical  Arts 

Natural  Science 

Social  Science 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Group  I 

1,     .     . . 

7.3 
3.8 
4.9 

9.1 
6.4 
0.0 

8.1 
5.3 
2.5 

11.4 
13.8 
22.2 

3  9 
6.4 
0.0 

6.3 
9.6 
9.8 

19  0 

9.6 

24.5 

7.6 
2  2 
6.7 

11.6 

5.9 

3 

15.0 

4 

y.6 

3.2 

6.6 

19.0 

7.4 

12.5 

18.7 

1.0 

8.8 

5 

9.8 

8.3 

S.9 

16.8 

16.3 

16.7 

10.7 

14.2 

12.9 

6 

8.8 

3.3 

4.4 

8.8 

0.8 

5.1 

2.5 

2.2 

2.3 

M 

8.0 

4.8 

6.0 

1,-,  :i           .-.  1     ;      9.7 

14  7 

(   .-.           11)  2 

Group  II 

1 

3.2 

1.8 

2.3 

16.5 

0.0 

4.5 

19.2 

2.8 

9.7 

2 

0.0 

2.3 

1.5 

6.4 

4.5 

5.8 

10.8 

9.7 

10.1 

3 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

0.0 

4 

0.0 

0.0 

0.0 

10.8 

.3 

9.4 

5.4 

7.4 

6.6 

5 

0.0 

0.0 

0.0 

0.0 

0.0 

0  0 

0.0 

0.0 

0.0 

M 

0.0 

0.0 

0.0 

6.4 

0.0 

4.5 

5.4 

2.8 

6.6 

Total  Medians 

3.8 

2.3 

2.5 

11.4 

3.9 

G.3 

10.7 

2.8 

8.8 
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TABLE  2. — Per  Cent  of  Failures  by  Years  (All  Subjects) 


GRADE 

IX 

X 

XI  and  XII 

All* 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Ciroup  I 

1         

Ifi  9 
10.1 
16.1 
32.2 
40.1 
22.3 

10.1 
11.9 
9.6 
10.0 
22.8 
11.5 

13.1 
14  2 
12.2 
17.1 
32.2 
17.2 

30.7 
10.5 

25,9 
19.8 
12.0 
13.4 

13.2 
13.1 
14.4 
2.3 
19.7 
18.8 

20.6 
11.6 
19.3 
10  3 
10.7 
16.2 

14.5 
16.8 
12.6 
15.7 
10.1 
3  5 

0.0 
2.9 
4  3 
13.5 
1.5 

7,3 
8,3 
7,8 
10,0 
12,3 
2.7 

16.2 
11.1 
12.1 
19.9 
22.3 
9.8 

8,2 
8,2 
5 , 5 
5 , 9 
10,3 
6.9 

11.6 

2 

9.7 

3     

9  6 

4         

12.0 

19.0 

6 

8.5 

M     

10.6 

11.7 

15.7 

16.6 

13.8 

10.5 

13  6 

2.8 

8.0 

14  1 

7.5 

10.7 

Gniu|i  II 

1                 

38.1 
17. S 
13.1 
19,3 
4.3 

1.3 
4.7 
0  0 
10.8 
5  3 

14.0 
12  I 
G.2 
15.1 

4.8 

17.4 
7  7 
0  0 
8.6 
5,9 

10  0 
8  0 
5 . 5 
4.7 
5  1 

13  2 
7,8 
15 
6.4 
5.6 

6  4 

17.6 
6.8 
0.0 
2.8 
4  3 

0  0 
5.0 
0.0 
3.3 
0.0 

7.9 
5.6 
0  0 
3  1 

2.8 

14.9 
9.4 
2  4 
6.5 
4,5 

2.0 
4  4 
13 
4.3 
3.8 

7  3 

•> 

6.7 

3 

2  1 

4 

5.3 

4,2 

M              

17.8 

4  7 
10.0 

12.1 

7.7 

5  5 

4.3 

0,0 

3  1 

6  5 

3.8 

5.3 

Total  Medians 

17.8 

14  2 

12.6 

10.0 

11  6 

10.1 

2,9 

7.3 

11,1 

5.5 

8.5 

*Pr;u'tical  art.'<  ar{<  IiicIiuUhI  iituU'r  nil.  but  not  iiiKlcr  IX,  X.  XT  and  XII. 
TABLE  o. — I'kk  Cent  op  Failures  in  Certain  First  Year  Hubjects 


SUBIECTS 

Griiup  and 
School 

Algebra  IB 

Botany  IB 

English  IB 

German  IB 

Latin  IB 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Boys 

Girls 

Total 

Roys 

Girls 

Total 

Group  I 

1 

14.6 
4.5 
32.1 
25.0 
36.7 
31.0 

16.2 
5.0 

24.3 
6.4 
0.0 

20.5 

15.4 
4.8 
27,7 
12.5 
19.4 
26.3 

0.0 
35.7 

7.7 
11.4 

5.3 
18.4 

9.3 
7.6 
3.1 
39.3 
35.3 
11.0 

8.3 
3.3 
2.8 
14.5 
19.5 
6.0 

8.9 
5.6 
2.9 
22.9 
26.7 
8.0 

13.8 
19.5 
22.6 
42.1 
59.0 
33.3 

9.4 
10.0 
3.6 

10.7 
43.6 

2.8 

11.5 
11.3 
13.6 
23.4 
51.3 
22  2 

33.3 
39.2 
21.4 
23.5 
39.1 
41.7 

0.0 
16.2 
8.3 
8.1 
31.0 
13.0 

13  3 

2         

25.4 

3 

13.2 

4 

0.0 
27.6 
30  8 

11.1 
0.0 
2.1 

10.7 
25.0 

8.2 

12  9 

34.8 

6 

27.7 

M 

28.0 

11.3 

17.4 

27.6 

7.7 

10.7 

10.2 

7.1 

8.5 

28.0 

9,7 

17.9 

36.3 

10.7 

19.3 

Grojp  II 

1 

35.7 
18.5 
50.0 
20.0 
5.6 

0.0 
8.1 
0.0 
9.5 
6.2 

15  1 
12.5 
20.0 
14.6 
5.9 

0.0 

7.1 

0.0 

21.1 

0.0 
7.6 
0.0 
13.6 

0.0 
7.4 
0.0 
17.1 

23  0 
8.5 
0.0 

16.3 
5.7 

0.0 
0.0 
0  0 
13.0 
12.5 

9.6 
5.8 
0.0 
14  6 
8.6 

50.0 
35.7 

0.0 
17.0 

6.2 

0.0 
0.0 
0.0 
12.0 
0.0 

30.4 
20  8 

0.0 
14.3 

4.0 

100. 
20.7 
12.5 
22.2 
0.0 

8.3 
9.1 
0.0 
9.1 
0.0 

15.3 

2     

19  2 

3        

6  7 

4 

15  0 

5 

0.0 

M 

20.0 

6.2 

14.6 

3.6 

7.1 

3.8 

3  7 

8.5 

0.0 
6.0 

8.6 

17  6 
22.6 

0.0 
3.6 

14.3 
14.3 

22.2 

8.3 

15  0 

Total  Medians.. . 

25.0 

6.4 

15.1 

7.6 

8.2 

9.3 

8.6 

26.7 

8.3 

15.0 
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Table  1  should  be  read  as  follows:  22  i)er  cent  of  the  boys, 
8.6  per  cent  of  the  girls,  and  14.5  per  cent  of  ])oth  fail  in  English 
in  School  No.  1.    Other  tables  are  to  be  read  similarly. 

Every  table  shows  a  wide  variation  among  different  schools 
when  compared  with  respect  to  failures  by  years  or  subjects. 
For  example,  Table  1  shows  a  range  in  Grouj)  I  of  .").!  per  cent 
to  18.7  per  cent  failures  in  EngUsh;  11.6  per  cent  to  33.7  per  cent 
in  foreign  language;  13.2  per  cent  to  22.1  per  cent  in  mathematics; 
2.5  per  cent  to  8.9  per  cent  in  practical  arts;  5.1  ])er  cent  to  1().7 
per  cent  in  natural  science;  and  2.3  per  cent  to  15  per  cent  in  the 
social  sciences. 

Ta])le  2  for  (Jroup  I  shows  a  range  from  12.2  per  cent  to  32.2 
per  cent  for  ninth  grade  failures;  10.3  per  cent  to  20.6  per  cent 
in  the  tenth  grade;  2.7  per  cent  to  12.3  per  cent  in  the  eleventh 
and  twelfth  grades;  and  8.5  per  cent  to  19  per  cent  for  all  com- 
])ined.  Even  greater  variations  are  apparent  between  schools 
for  failures  in  first  term  sul)jects.  School  5  of  Group  I  has  a 
very  high  failure  rate,  19  per  cent  for  all  su])jects  and  years 
combined  (Table  3),  while  school  3  of  Group  II  has  an  exceedingly 
low  rate,  2.1  per  cent.  School  5  of  Group  I  reported  a  59  per  cent 
failure  rate  in  first  term  German  for  boys  and  51.3  per  cent  for  boys 
and  girls  together.  It  would  appear  that  the  standards  of  this 
school  would  result  in  the  elimination  of  many  pupils.  Census 
and  enrollment  data  show  this  school  to  have  a  smaller  per  cent 
of  its  population  in  high  school  than  any  city  of  its  class  reporting 
for  this  study. 

An  inspection  of  the  table  shows  that  a  wide  variation  also 
exists  with  respect  to  failures  by  subjects.  Table  1  for  Group  I 
shows  a  range  from  6  per  cent  for  practical  arts  to  18.3  per  cent 
for  mathematics.  This  indicates  that  all  subjects  have  not  been 
equally  well  organized  and  standardized.  Mathematics  and  the 
languages  are  responsil)le  for  a  very  large  per  cent  of  failures, 
in  some  cases  including  more  than  50  per  cent  of  all  pupils,  while 
in  some  schools  all  pupils  are  passed  in  practical  arts  and  the 
special  subjects.  Here  the  time  element  seems  to  be  the  only 
requirement  for  passing.  One  sometimes  becomes  suspicious  of 
the  reasons  given  for  the  popularity  of  these  courses. 

In  all  respects  in  which  these  data  have  been  compared,  lack 
of  fixed  norms  or  standards  is  apparent.  It  is  hoped  that  this 
summary,  while  not  based  upon  extensive  data,  may  be  suggestive 
for  comparative  purposes. 


Observations  on  the  Teaching  of  First  Term 

Algebra 

.l\Mi;s   Z.    A.    Mcf 'aimmi AN,   of   tlic   Hlooiniriiitoii    lliyli    Scliool 


Tins  cxix'rinicnt  was  undertaken  at  the  be<i;innint>;  of  th(>  first 
semester  of  the  jiresent  school  year.  It  was  proposed  to  treat 
thi'cc  sections  of  l)e,<;inniii<;'  alt;('l)ra  pupils  under  the  same  teacher 
hy  the  tlu'ei'  |)laiis  outhned  below  and  to  nud-ce  comi)aris<m  of 
i-esults.  The  scheme  was  to  he  carried  out  in  several  high  schools 
ill  the  State,  hut  seems  to  hav(>  failed  of  execution  in  other  schools. 

Section  one.  Pupils  of  this  section  were  to  have  the  ordinary 
|)laii  of  recitation  and  were  to  study  when  they  pleased  and  as 
much  as  t  hey  pleased. 

ScclioN  hrn.  Pu])ils  of  this  section  were  to  have  a  divided 
recitation.  .Vhout  fifteen  minutes  of  the  time  was  to  he  devoted 
to  fi'enei'al  and  ])ersonal  instruction  and  the  rest  of  the  jjci'iod  to 
the  ordinary  testing  out  of  the  i)Ui)ils'  preparation  of  the  lesson. 
These  iMi])ils  w(M'e  to  study  hut  one  recitation  ])eri()d  daily  and  that 
in  the  school  study  room.  Altho  there  was  an  attempt  made, 
the  instructor  found  himself  unahle  to  control  definitely  and 
regularly  the  division  of  time  in  the  rcM'itation. 

Section  three.  These  pupils  had  the  ordinary  recitation  and 
studied  the  ])erio(l  following  under  the  sui)ervision  of  the  teacher. 
They  were  to  have  no  other  study  time. 

Section  one  recited  at  1:00  p.m.;  section  two,  at  1:45;  section 
three,  at  2:'M).  This  made  the  study  period  for  section  three  last 
from  3:15  to  4:00,  the  most  unfavorable  period  of  the  day. 

Previous  to  the  division  of  these  ])upils  into  sections  there 
was  no  attempt  to  classify  them  according  to  their  record  in 
arithmetic.  The  data  on  this  point,  given  later  in  this  report, 
were  obtained  after  the  close  of  the  semester  in  algebra.  With  the 
purpose  of  making  it  easy  to  get  the  final  arithmetic  grades, 
pupils  from  the  city  schools  were  taken  as  far  as  possible  for  these 
sections.  These  pupils  seemed  to  be  representative  of  the  ordinary 
eighth  grade  graduates,  with  the  exception  of  one  member  of  sec- 
tion three,   who  never  made  a  passing  grade  in  8B  arithmetic, 
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and  for   whom   a  great   amount    of   personal   lielp   seemed   to   do 
little  good. 

The  grades  of  the  repeaters  in  the  three  sections  are  such  as 
to  have  no  effect  on  the  figures  for  the  final  results. 

TABLE   1. — Comparison  of  Aloehr.a  SiornoNs 


Sep.     I  recited  at  1:00  p.m.;  no  limitations  on  study  time 

Sec.    II  recited  at  1:45  p.m.;  study  time  limited  to  one  ?chool  iieriod  daily 

Sec.  Ill  recited  at  2:45  p.m.;  study  period,  3:20-4:00  supervised. 


Column 

1 

2 

3 

4 

5 

?■ 

B 

S 
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S 

"w 
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Z 

o 

O 
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a 
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3 
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P 
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i 

B 
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5 
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•^ 

•^ 

Ranking  of  pupils  in  final  Arithmetic 
and  Algebra  grades 
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S 
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C 

p 

s 
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3 
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3 

z 

Sec.     I 

27 

3 

24 

8 

1 

7 

7 

6 

Sec.   II 

26 

2 

24 

1 

1 

1 

10 

3 

Sec. Ill 

26 

3 

23 

0 

3 

3 

8 

3 

2 

85.5 

86.3 

39.1 

18 

75. 

6 

3 

80.5 

84.3 

33.4 

20 

83.3 

4 

3 

81. 

86. 

36.8 

21 

92.3 

2 

:83.3 


Total 


11      25      12      14 


22      11      26 


TABLE  2. — Standing  of  These  Sections  as  Determined  by  the  Indiana 
University  School  of  Education  Algebra  Tests 


tests 

MEDIAN   OF 
ATTEMPT 

MEDIAN  OF 
RIGHTS 

PERCENT   OF 
ACCUR.'VCY 

Sec. 
I 

Sec. 
II 

Sec. 
Ill 

Sec. 
I 

Sec. 
II 

Sec. 
Ill 

I 

Sec. 
II 

Sec. 
Ill 

7.8 

8.1 
10.25 
4.8 
4.5 
6.5 
6.9 

7.2 

7.7 
10.4 
4.8 
4.2 
6.4 
6.8 

8.75 

7.7 

8.9 

4.9 

4.4 

7. 

6.1 

4.8 

6.9 
6  5 
2  4 
3.5 
3.9 
5.1 

6.2 

7. 

7.7 

2.1 

3.2 

4.6 

5.3 

7. 
7.3 

61.5 

85.2 

86.1 

90.9 
74. 
43.7 
76  1 
71  S 
77.7 

80, 

2.  Multiplication     from 

(            ) 

93,5 

3.  One-process  equations 

75    1     63.4 
2.25   '    .50. 

84  3 
45  9 

5.  Transposing  terms.     . 

6.  Collecting  terms 

7.  Forming  equations.  .  . 

3.7 

5. 

4,9 

77.8 

60. 

73,9 

84.1 
71  4 
80.3 

13 
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A  study  of  Ta])l(^s  1  and  2  shows  tluit  s(»ction  three  excelled 
in  almost  all  ])oints  of  conii^arison.  This  nii<i;ht  he  expected  where 
tlie  size  of  classes  was  ])racti('ally  the  same.  This  suggests  that 
a  l)etter  ])lan  for  making  comparison  of  results  would  be  to  take 
50  pupils  in  oik^  section  with  a  ])eriod  of  supervised  study  and  com- 
l)are  the  outcome  with  two  sections  of  2")  ])u])ils  each  without 
supervised  study. 

In  the  light  of  this  exi)erimeiit,  does  the  double  ])eriod  with 
su]X'rvised  study  pay?  If  we  consider  the  (;ost  of  instruction,  we 
would  say  that  it  cost  twice  as  much  to  accomi)lish  a  passing  grade 
for  21  ])upils  in  one  section  as  it  did  for  20  ))upils  in  each  of  two 
other  sections.  Against  this  is  to  be  ])lac(Ml  a  small  but  clear  gain 
in  efficiency  percentage,  and  a  clear  gain  in  numl)er  of  pui)ils 
passed.  The  ])ercentage  of  gain  in  number  passing  indicates  that 
7  or  8  of  the  10  not  passing  in  sections  one  and  two  might  have 
been  saved  by  su])ervis(Ml  study. 

Does  supervis(Ml  study  pull  up  the  weaker  pupils  and  pull  down 
the  stronger?  The  number  of  [lupils  is  too  small  in  this  experiment 
to  warrant  any  assertion  in  answer  to  this  question.  Those  who 
think  that  supervised  study  has  a  tendency  to  i)ull  down  the 
brighter  j)upils  may  get  some  indication  favorable  to  their  opinion 
by  a  study  of  the  number  in  the  highest  rank  of  section  2  (column 
6,  Table  1)  in  connection  with  their  numlier  of  minutc^s  of  daily 
study  (column  9,  Table  1). 

The  use  of  the  Indiana  University  School  of  Education  Algebra 
Tests  (see  Table  2)  gives  a  means  of  comparing  these  sections  in 
important  details  of  their  work.  This  table  brings  out  clearly 
the  strong  places  and  the  weak.  All  sections  are  strong  in  sub- 
traction and  weak  in  division,  the  operation  in  which  we  would 
expect  the  subtraction  ability  to  help  in  producing  better  results. 
The  fact  that  the  "tests"  tell  the  same  story  in  favor  of  section  3 
as  do  other  modes  of  comparison  tends  to  show  that  they  are 
reliable  as  measures  of  the  pupils'  progress  and  as  a  means  of 
comparing  classes  and  schools. 

In  these  days  we  are  making  great  plans  for  predicting  a  pujiil's 
course  of  study  by  what  he  has  already  done.  Suppose  that  these 
pupils  had  been  sectioned  for  algebra  on  the  basis  of  their  final 
grades  in  arithmetic.  Columns  5,  6,  7,  Table  1,  show  in  one  way 
how  much  mistaken  we  might  have  been.  Only  25  per  cent  of 
the  lowest  one-third  of  algebra  pupils  would  have  been  properly 
classified;  19  per  cent  of  the  middle  one-third,  and  52  per  cent 
of  the  highest  one-third. 
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TABLE  3. — Final  Arithmetic  Grades 


Lowest 
Third 


Middle 
Third 


Highest 
Third 


Number  of  pupils 

Per  cent  staying  in  the  same  third  in  algebra 
Per  cent  moving  to  a  higher  third  in  algebra 
Per  cent  moving  to  a  lower  third  in  algebra  . 


25 
25 

41.7 
*33.3 


26 
19.2 

57.7 
23.1 


21 
52.4 


*Pupils  not  passing  in  algebra. 

Of  the  12  failures  in  alge])ra,  2  were  from  the  mitldle  third 
in  arithmetic;  10  from  the  lowest  third.  Of  the  12  hio'hest  in 
algebra,  1  came  from  the  lowest  third;  7  from  the  micklle  third; 
and  4  from  the  highest  third. 

The  Pearson's  coefficient  of  correlation  of  final  arithmetic 
and  final  first  term  algebra  grades  is  +.458. 

These  comparisons  seem  to  afTord  little  encouragement  for 
pro])hesying  what  a  pupil  may  do.  Cold  figures  take  no  account 
of  the  effect  of  increased  age  and  development,  new  environment, 
new  resolutions,  and  new  motives  for  effort. 


The  Measurement  of  Reading  in  Indiana 
Schools  (Abstract) 


Mklvin    Vj.    II A(i(iKitTY,    ProfVssor   of    Educational    l*sycliol()}j;y,    Unixcrsity 

of  Minnesota. 


TiiK  'riionidikc  rcadinj;  tests  were  «>;iv('n  in  more  tliun  a  score 
of  Indiana  cities  in  May,  1915.  The  results  of  these  tests  were 
sent  to  Indiana  University  and  were  there  tabulated  and  com- 
l)arative  scores  were  made  out.  Additional  tests  were  given  in 
about  twenty-five  cities  in  l)<'ceinber,  1915.  Tiiese  additional 
tests  were  <!;iven  with  a  view  to  extendinji;  the  orij>;inal  scales, 
making  them  serviceable  over  a  wider  area,  and  for  purposes  of 
re-examination  after  practice.  The  results  of  these  tests  show  wide 
variations  in  reading  ability  in  <>ach  of  tiie  several  gra(h's  and 
among  the  classes  of  the  same  grade  in  the  several  cities.  A 
complete  report  coxcring  individual,  class,  and  school  scores  for 
the  several  periods,  the  relations  of  s(>x,  ag<',  and  time  to  the 
effici(>ncy  in  reading,  and  a  considerable  amount  of  material  on 
the  extension  of  the  scales  is  in  jjreparation  and  shouhl  be  avail- 
able within  a  short  time. 
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Appendix 

#**This  appendix  belongs  to  the  paper  of  Mi-.  15.  K.  Biickingliani,  p.  40. 


MARCH  TEST  IN  ARITHMETIC 

1.  If  a  map  10  inches  wide  and  16  inches  long  is  made  on  a  scale  of  50 
miles  to  the  inch,  what  is  the  area  in  square  miles  that  the  map  represents? 

2.  Cream  is  sold  in  half-pint  bottles.  If  a  milkman  buys  it  at  $1.20  a 
gallon  and  it  costs  40  cents  a  gaUon  to  bottle  and  deliver  it,  at  what  price 
per  bottle  must  it  be  sold  to  gain  20  per  cent? 

3.  A  fruit  dealer  bought  300  apples  at  the  rate  of  5  for  a  cent,  and  300 
at  4  for  a  cent.  He  sold  them  all  at  the  rate  of  8  for  5  cents.  Whal  did  iit^ 
gain  on  the  investment? 

4.  A  family  used  14  bu.  of  potatoes  a  month.  How  much  will  be  saved 
each  month  by  buying  them  at  $1.30  a  bushel  instead  of  at  8  cents  a  quart? 
(8  qts.   =  1  pk.;  4  pks.   =  1  bu.) 

5.  James  buys  papers  at  10  for  6  cents  and  sells  them  at  1  cent  eacli. 
If  his  sales  average  100  a  day  for  6  days,  what  does  he  add  to  the  family 
income  after  keeping  $0.10  for  himself? 

6.  The  7A  class  has  42  on  roll  and  only  3  absent  today;  and  the  7B  class 
has  48  on  roll  with  4  absent.  Which  has  the  better  percent  of  attendance  and 
how  nnich? 

7.  Bought  pencils  at  $1.20  per  gross,  and  sold  them  at  1  cent  each.  Find 
the  gain  per  cent. 

8.  A  family  pays  $25  a  month  for  a  non-heated  flat  and  uses  5  tons  of 
coal  at  $7  per  ton  for  heating  purposes  during  the  winter.  If  they  moved 
to  a  steam-heated  flat  at  $30  a  month,  would  they  increase  their  expenses 
for  the  year  or  not,  and  how  much? 

9.  The  value  of  the  men's  factory  products  in  the  leading  centers  of  the 
United  States  was  as  follows: 

1860  1900 

New  York $17,011 ,370  $103,220,201 

Baltimore 3, 124,342  17,290,825 

Boston 4,567,749  8,601  ,431 

Chicago 540 ,  709  36 ,  094 , 3 10 

Philadelphia 9 ,  962 ,  800  18 ,  802 ,  (537 

Find  the  increase  or  decrease  in  the  value  of  the  men's  factory  products 
in  1900  as  compared  with  that  of  1860. 

10.  Two  boys  made  a  gallon  of  lemonade,  using  16  lemons  at  30  cents 
a  dozen  and  2  pounds  of  sugar  at  6  cents  a  pound.  They  sold  it  at  5  cents 
a  glass,  6  glasses  to  a  quart.    How  much  was  each  boy's  share  of  the  gain? 
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JUNE  TEST  IN  ARITHIMETK' 

1.  A  fanner  has  a  herd  of  12  dairy  cows  tlial  avcra^i?  22  poiiiids  each  of 
milk  per  day.  The  milk  contains  '.i.S  per  cent  butter  fat.  and  Inittcr  fat  is 
worth  2S  cents  per  pound.     What  is  the  (hiily  income  from  the  herd':* 

2.  I  am  makinfi;  a  handkerchief  out  of  a  piece  of  linen  lOi  inches  square. 
If  I  make  a  J-incli  hem  all  around  it,  how  long  and  wide  will  it  be  when  fin- 
ished'.' 

A.  if  Te.xas  is  2i;i.()(i  times  as  larj^e  as  Rhode  Island,  and  New  \'()rk  is 
;i9.44  times  as  larjje  as  Rhode  Island,  then  Texas  is  how  many  times  as  larj^(> 
as  New  York?     E.xpress  to  the  nearest  second  decimal  place. 

4.  According  to  the  report  of  the  Bureau  of  Census,  the  numbers  of 
persons  engaged  in  the  different  groups  of  occupations  in  the  Ignited  States 
in  ISSO  and  IDIO  were  as  follows: 

1880  1910 

Agricultural  pursuits 7  , 7 1  .S  ,  875  12, 5(17. 925 

Trad(!  and  trans])ortation 1  ,S71  .5():'>  7,()05,7:iO 

Manufacturing  pursuits ii, 784. 720  10.807  ,.521 

I^rofessional  services 003  ,  202  1  .  S25 .  1 27 

Domesticaiid  personal  ser\  ices  ;i,4I8,79;>  5  ,;{()l  ,();>;i 

Find    the   total   increase   in    the   number  of   persons  employed    in    the  United 
States  in  1910  over  those  employed  in   1880. 

5.  A  can  of  milk  containing  40  quarts  costs  fl.bO.  What  per  cent  is 
gained  by  selling  the  milk  for  0  cents  a  quart? 

(■).  I  bought  a  cask  of  molasses  containing  84  gallons  for  .1l>28.  Nine 
gallons  having  leaked  out.  at  what  price  per  gallon  nuisf  I  sell  the  remainder 
to  gain  .ii;4.25? 

7.  .\  farmer's  wife  bought  2.75  yards  of  table  linen  at  $0.87  a  yard  and 
10  \ards  of  flamiel  at  S0..55  a  yard.  She  paid  in  butter  at  $0.27  a  pound. 
How  man\   pounds  of  l)ntler'  was  she  obliged  to  gi\'e? 

8.  .\  man  and  l)oy  together  spaded  9-10  of  a  garden.  If  the  man  spaded 
twice  as  nuicli  as  the  bo,\-,   what    part   of  the  garden  did  each  s|)ade? 

9.  A  contractor  completed  g  of  a  job  in  121  days.  How  much  longer 
should  it  take  to  finish  the  job? 

10.  In  a  certain  state  the  cost  of  building  a  macadam  road  is  shared  by 
the  town,  county,  and  state.  The  state  pays  I,  the  ccmnty  J,  and  tiie  town 
the  remainder.     If  the  state  pays  .$1,200,  what  does  the  town  l)ay? 


MARCH  TEST  IN  GEOGRAPHY 

1.  In  what  country  is  Berlin? 

2.  What  is  the  (capital  of  New  York  State? 
■i.  What  is  the  chief  e.xport  of  Brazil? 

4.  In  what  state  is  Paterson? 

5.  Name  a  railway  system  connecting  New  York  and  Chicago. 

6.  Name  a  leading  state  of  the  United  States  in  the  production  of  cotton. 

7.  Name  a  cit^-  that  is  in  North  Latitude  and  also  West  Longitude. 
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S.   'riirough  what  city  does  the  Prime  Meridian  pass? 

(».   Wliat  changes  are  caused  by  the  r()tati(»ii  of  tlie  earth  on  its  axis? 

10.  lu  what  state  is  Pike's  Peak? 

1 1.  Name  an  important  export  from  Buenos  Aires. 

12.  Name  the  three  most  important  countries  of  Soutli  America. 
1.3.  From  what  is  latitude  reckoned? 

14.  What  state  is  next  north  of  Illinois? 

15.  What  is  the  latitude  of  New  York  City? 
10.   In  what  city  is  Harvard  University? 

17.  Name  a  city  that  is  in  North  Latitude  and  also  in  Kast  ivongitude. 

18.  Name  the  six  great  powers  of  Europe. 

19.  South  of  the  equaeor  in  what  direction  do  the  trade  winds  bkjw? 

20.  Through  what  waters  would  you  pass  in  going  from  the  Black  Sea  to 
the  Atlantic  Ocean? 


JUNE  TEST  IN  (JEOCiRAPHY 

1.  In  what  country  is  London? 

2.  What  is  the  capital  of  the  United  States? 

3.  Name  the  six  continents. 

4.  In  what  state  is  Baltimore? 

5.  Name  the  five  Great  Lakes. 

6.  Name  the  two  principal  mountain  systems  of  North  America. 

7.  Name  the  zones  into  which  the  earth  is  divided. 

8.  What  river  forms  a  portion  of  the  boundary  between  Eurojx'  and 

Asia? 

9.  What  circles  bound  the  Torrid  Zone? 

10.  Name  a  leading  state  of  the  United  States  in  the  production  of  wheat. 

11.  For  what  industry  is  Pittsburg  noted? 

12.  What  changes  are  caused  by  the  revolution  of  the  earth? 

13.  Name  an  important  city  on  the  Danube  River. 

14.  What  state  is  south  of  Utah? 

15.  How  many  degrees  of  latitude  are  there  between  the  North  Pole  and 

the  South  Pole? 

16.  Name  an  important  city  on  tlie  Clyde  River. 

17.  Name  the  cardinal  points. 

18.  Name  three  public  buildings  in  Washington,  D.C 

19.  How  many  miles  (about)  are  there  in  a  degree  of  latitude? 

20.  Name  a  city  that  is  in  South  Latitude  and  also  in  East  Longitude. 
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1.  In  what  war  was  the  battle  of  Gettysburg  fought? 

2.  At  about  what  time  was  the  first  message  sent  by  telegraph? 

3.  Name  three  American  generals  in  the  Revolutionary  War. 

4.  What  were  two  important  problems  facing  the  United  States  govern- 

ment during  Jackson's  administration? 
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5.  State  one  important  gen(>ral  plan  carric'd  oul   by  the  navy  of  lli(> 

North  in  the  C\vi\  War. 
().  Mention  two  of  the  principal   weaknesses  of  llic  government  niuler 

the  ArtieU'S  of  Confederation. 
7.   lliuler  whose  administration  was  the  ("i\il  Ser\  ice  Cominission  rstah- 

Ushed? 
S.  Of  wliat  political  party  was  Alexander  Hamilton  a  leader? 

9.  What  problem  gave  rise  to  the  Free  Soil  Party? 

10.  In   general,   what  was  the  attitiid(>  of   England   towards   the   South 

during  the  Civil  War? 

11.  What  is  the  provision  of  the  Constitution  regarding  the  nuint)er  of 

members  in  tlie  Senate? 

12.  To  what  i)olitical  jjarty  in   England  did  most   of  tlie  settlers  of  Vir- 

ginia belong? 

13.  What  conclusion  should  be  drawn  from  the  following  statements: 

(a)  Tlie  farms  of  New  England  paid  j)o()rly  in  ISOO. 

(b)  The  New  P]ngland  streams  furnished  plenty  of  water  power  in 

1800. 
(e)    During  the  50  years  preceding   1800,   new  machines  w(>re  in- 
vented   that    made    manufacturing    much    Tuore    rapid    and 
profitable  and  these  could  be  operated  by  water  power. 

JUNE  TEST   IX    HISTORY 

1.  Cii\-e  the  nami-  of  the  treaty  made  as  a  result  of  the  Kevolutionary 

War. 

2.  When  was  the  cotton  gin  invented? 

3.  What  colony  in  America  was  founded  by  English  Catiiolics? 

4.  In  what  year  did  government   under  the  Constitution  of  the  ITnited 

States  begin? 

5.  What  is  the  main  puri)ose  of  the  Monroe  Doctrine? 

G.   To   what  sectitm   of   the   United   States  did    the   Ordinance    of   1787 
ai)ply? 

7.  In   thi'  Civil   War  the  North  was  fighting  to  estal)lisli  a  great   con- 

stitutional i)rinci})le.    What  was  that  i)rinciple? 

8.  What  condition  in  England  led  to  the  settlement  of  Georgia? 

9.  From  what  i)art  of  Europe  did  the  great    majority  of  immigrants 

come  before  the  Civil  War? 

10.  To  what  religious  body  did  most  of  the  settlers  of  Pennsylvania 

belong? 

11.  Give  the  substance  of  one  amendment  of  the  Constitution  made  as 

a  result  of  the  Civil  War. 

12.  What  critical  problem  arose  during  Buchanan's  administration? 

13.  What  conclusion  may  be  drawn  from  the  following  statements: 

(a)  In  1880  the  manufactured  products  of  the  South  were  valued 

at  $500,000,000,  or  one-eleventh  of  the  total  for  the  whole 
United  States. 

(b)  In  1900  they  had  risen  to  $1,500,000,000,  or  one-ninth  of  the 

totals  for  the  whole  United  States. 
(e)   In   1905  they  were  valued  at  $2,200,000,000,   or  one-seventh 
of  the  total  for  the  whole  United  States. 
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MARCH  TEST  IN  GRAMMAR 
Seventh  Grade — First  Half 

1.  Give  the  part  of  speech  and  the  syntax  of  the  undcHined  word  in  the 

following  sentence: 

Certain  birds  nest  in  the  vicinity  of  our  houses. 

2.  Give  an  example,  in  a  sentence,  of  a  predicate  nominative,  and  under- 

line it. 

3.  Draw  one  line  under  the  complete  subject  and  two  lines  under  the 

complete  predicate  in  the  following  sentence: 

Down  through  the  green  leaves  the  sun  was  pouring  his  si)lendor. 

4.  Analyze:    Now  swiftly  glides  the  bonny  boat. 

5.  Write  a  sentence  containing  a  relative  pronoun  in  the  objective  case, 

and  underline  the  word. 

6.  In  the  following  sentence,  give  the  case  of  the  undei-lined  word  and 

state  how  it  is  used  in  the  sentence: 

I  gave  him  a  letter  for  my  friend,  the  attorney. 

7.  Give  an  example,  in  a  sentence,  of  the  positive  degree  of  the  adverb 

better  and  underline  it. 

8.  Draw  a  line  under  all  the  nouns  in  the  following  passage: 

In  winter  I  get  up  at  night 
And  dress  by  yellow  candlelight. 
In  summer,  quite  the  other  way, 
I  have  to  go  to  bed  by  day. 

9.  Pick  out  the  phrase  in  the  following  sentence  and  tell  what  it  modifies: 

The  windows  were  white  with  frost. 
10.  Underline  all  the  pronouns  in  the  following: 

I  tell  you  he  is  a  selfish  fellow,  one  whose  only  thought  is  of  him- 
self. Those  who  have  anything  to  do  with  him  are  likely  to 
regret  it. 

JUNE  TEST  IN  GRAMMAR 
Seventh  Grade — First  Half 

1.  Copy  each  underlined  noun  and  \vrite  after  it  its  number,  gender, 

and  case: 

Lafayette,  the  friend  of  Washington,  was  a  French  noblenum. 

2.  Use,  in  a  sentence,  a  personal  pronoun  in  the  first  ])ers()n,  jilural 

number,  objective  case,  and  underline  it. 

3.  How  may  an  adjective  clause  be  distinguished  from  an  adverbial? 

4.  Underline  the  subject  word  once  and  thi^  verb  twice  in  the  following 

sentence : 

The  cold  November  rain  is  falling. 

5.  Write  a  sentence  containing  the  comparative  of  ill,  and  underline 

the  word. 
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().  Anulyzc: 

Ammonia  is  roiiiul  in  the  sa|)  of  trees,  and  in  I  lie  jniees  of  all  vvav- 
lahles. 

7.  Write  the  reminiiie  of  lord.  earl,  tif^er. 

8.  Make  tiie  necessary  correction  in  the  following-  sentetice: 

1  am  snre  it  could  not  luive  l>een  them. 

9.  Give  an  exaini)le.  in  a  sentence,  of  an  adverh  of  time,  and  underline  it' 
10.    Write  a  sentence  containint::  a  noun  i)hrase,  and  underline  the  plirase 


MARCH  TEST  IX   (iKAMMAR 

SiocoM)   Half  of  Seventh  (Iijadk  to  Second  Half  oh' 
lOuiiiTii  (Ihade 

1.    Analyze  the  followinj^  sentence: 

Columbus  did  not  know  that  he  had  discovered  a  new  continent. 
2.<  Make  a  list  of  tlie  verbs  in  the  foUowinj?  sentences  and  after  each  \  erb 

write  its  mode,  voice,  and  tense: 
("assius,  be  not  deceived. 
A.    Death  will  certainl\   knock  at  ever\   door. 
I.   The  territory  claimed  l)y  the   Knjjlish   had  been  called  New  Xether- 

latid. 
.").   Write  the  principal  parts  of  surcp,  (lrip<\  irrilc     In  each  of  the  follow- 
ing-  sentences   select   the   subordinate   clauses   and    tell    the   s\nta.\ 

(use  in  the  sentence)  of  each: 
(i.   Books  were  written  that  they  miy;ht  ^ive  pleasure. 
7.    I    was  reminded  of  those  days  when    I    had   known   neither  care  nor 

.sorrow. 
<S.   The  children    i)layed   that    they   were  keepiii^^   house. 
0.   Write  a  sentence  containing-  a  relative  pronoun  in  tlu'  objective  case, 

and  underline  the  word. 

10.  Iti  the  follovviuf?  sentence  give  the  ca.se  of  the  underlined  word  and 

state  how  it  is  used  in  the  sentem-e: 

I  fijave  him  a  letter  for  my  friend,  the  attorney. 

11.  (Jive  an  example,  in  a  sentence,  of  the  positive  degree  of  the  adverl) 

better  and  underline  it. 

12.  Draw^  a  line  under  all  the  nouns  in  the  following  passage: 

In  winter  I  get  up  at  niglit 

And  dress  by  yellow  (uxndlelight. 

in  summer,  quite  the  other  way, 

1  have  to  go  to  bed  by  day. 
V.i.   Pick  out  the  phrase  in  the  following  sentence  and  tell  what  it  modifies: 

The  windows  were  white  with  frost. 
14.   Underline  all  the  i)ronouns  in  the  following: 

I  tell  you  he  is  a  selfish  fellow,  one  whose  only  thought  is  of  himscilf. 
Those  who  have  anything  to  do  with  him  are  likely  to  regret  it 
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JUNE  TEST  IN  GRAMMAR 

Second  Half  of  Seventh  Grade  to  Second  Half  of 
Eighth  Grade 

1.  Copy  each   underlined  noun  and  write  after  il    its  ntiinl)er,   <!:en(Ier, 

and  ease: 

Break,  break,  break! 

On  thy  eold  gray  stones.  Oh,  sea. 

2.  Pick  out  the  verb  in  the  following  sentence  and  after  it    write  its 

mode,  voice,  and  tense: 

A  shower  has  been  brought  on  by  the   mild  summer  breeze. 

3.  Give  an  example  in  a  sentence  of  a  participle  used  as  a  noun  and 

underline  it. 

4.  Give  an  example  in  a  sentence  of  an  infinitive  in  the  passive  voice. 

5.  Write  a  sentence  illustrating  the  use  of  few  as  an  adjective  pronoun 

(indefinite  pronoun).  *~^ 

6.  Give  an  example  in  a  sentence  of  that  used  as  a  conjunction,  and  under- 

line it.  ' 

7.  Combine    the   following   statements   into    a   complex    sentence   con- 

taining liut  one  subordinate  clause: 

In  May  a  sparrow  built  its  nest.     The  sparrow  had  evidently 
met  with  disaster  earlier  in  the  season.     It  built  its  nest  in 
a  mass  of  woodbine.     The  mass  was  thick.     The  w()<)d})ine 
was  near  my  window. 
S.  Write  the  first  person,  singular,  of  the  folio w^ing: 

Passive  voice,  indicative  mode,  present  tense  of  the  verb  "lead". 
9.  Write  a  sentence  containing  the  comparative  of  ill,  and  underline 
the  word.  '~^ 

10.  Change  the  following  complex  sentence  into  a  simple  sentence  without 

altering  its  meaning: 

We  saw  that  it  was  wise  to  give  in. 

11.  Write  the  feminine  of  lord,  earl,  tiger. 

12.  Make  the  necessary  correction  in  the  following  sentence: 

I  am  sure  it  could  not  have  been  them. 

13.  Give  an  example  in  a  sentence  of  an  adverb  of  time,  and  underline  it. 

14.  Write  a  sentence  containing  a  noun  phrase,  and  underline  the  i)hrase. 
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Pkk  Cknt  of   PiTi'ii.s  Ansvvkkinc   Each  Question   CoKifKCTLv,  7tii    and 

StH    (iRAUKS    COMBINEU 


Arithmetic 

Geography 

His 

ory 

Grammar 

tjtU'stioMS 

March 

June 

March 

June 

March 

Juno 

7> 

72. 
March 

8= 

March 

June 

June 

1            .  . 

20  0 
39.5 
(iO  0 
50.7 
52  3 
40  2 
(18.1 
4(i.(i 
57  0 
51  i) 

33  (1 
16.1 
05  7 
78.2 
SO .  S 
45  2 
05  7 
55.3 
45  4 
4!)  0 

07.5 
94  0 
77.7 
,S8.3 
07  1 
00 , 3 
75,0 
71. S 
00.2 
60.2 
38.8 
08.0 
55  1 
20.7 
38.4 
24.2 
35.3 
43.3 
7.8 
12.8 
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96 . 4 
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88 . 3 
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43  0 
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39.7 
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20.4 
01.1 
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23.9 
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30.0 
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32.3 
25.3 
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36.7 
38.0 
22.0 
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14           .... 
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Extension  Division  Publications 


Unless  a  price  is  stated  publications  are  free.  Where  publications  are  marked 
with  an  asterisk  (*)  reduced  rates  arc  made  for  purchases  in  (luantity.  A  limited  num- 
ber of  copies  of  publications  marked  with  a  dagger  (t)  are  distributed  free  of  charge 
to  citizens  of  Indiana. 

Circulars  of  Information — 

Community  Institutes:  Explanation  and  Suggested  Programs. 

Community  Instittites:   Methods  of  Organization. 

Public  Discussion:  Package  Libraries. 

Visual  Instruction:  Motion  Pictures. 

Club-Study:   Departments  and  Courses  of  Study. 

PubUc  Discussion:  Debates. 

Extension  Lectures:  List  of  Speakers  and  Subjects. 

Correspondence-Study:  Courses  in  Elementary  Mathematics 

Play  and  Recreation. 

Fourth  Exhibit  of  Pictures:     Japanese  Prints. 

Commencement  Lectures:     A  List  of  Speakers  and  Subjects. 

Public  Library  Lecttu'es. 

Bulletins — 

Proceedings  of  a  Conference  (First)  on  Taxation  in  Indiana   (1914).     50  cents. 
Proceedings  of  a  Conference  (Second)  on  Taxation  in  Indiana  (1915).     25  cents. 
Public  Discussion  Manual  for  Civic  Discussion  Clubs. 
♦Proceedings  of  a  Conference  on  the  Question  "Shall  a  Constitutional  Convention 

be  called  in  Indiana?"     25  cents. 
Proceedings  of  a  Conference  (First)  on  Educational  Meastirements  (1914).     (Out 

of  print.) 
tProceedings  of  a  Conference  (Second)  on  Educational  Measurements  (1915).     50 

cents. 
PubUc    Discussion:     State    High    School    Discussion    League    (County    Govern- 
ment), (1914-15). 
Pubhc    Discussion:     Stale    High    School    Discussion    League    (Municipal    Home 

Rule),  (1915-16). 
A  Manual  of  Pageantry. 

Extension  Division  Announcements  (191C-17). 
History  Consultation  Service. 
History  Teaching  in  the  Secondary  Schools:  A  Conference  held  at  Gary,  Ind. 

(Out  of  print.) 
tProceedings  of  the  Indiana  Newspaper  Conference  (1915).     25  cents. 
Correspondence-Study. 

Lantern  Slides:   Rules  for  Borrowing,  Catalog,  and  Suggestions  for  Use. 
The  Community  Schoolhouse:   Bibliography,  Notes,  List  of  Lantern  Slides. 
First  Loan  Exliibit  of  Pictures:  A  Catalog,  with  Notes. 
Early  Indiana  History:   Bibliography,  Notes,  and  List  of  Lantern  Slides. 
Indiana  Local  History:   A  Guide  to  its  Study,  with  some  Bibliographical  Notes. 
Westminster  Abbey:  A  Lecture  to  Accompany  Lantern  Slides. 
Reference  Aids  for  Schools. 
Community  Welfare  Programs. 
Play  and  Recreation:     Four  Papers  read  at  the  Indiana  State  C:;onference  on  Play 

and  Recreation.      (Vol.  I,  No.  11.) 
Play  and  Recreation:     Four  Papers  read  at  the  Indiana  State  Conference  on  Play 

and  Recreation.      (Vol.  II,  No.  1.) 
Extension  Courses  of  Instruction  at  Indianapolis. 
Public    Discussion:    State   High   School    Discussion   League    (Military  Service). 

(1916-17). 
Community  Instituc-es. 

Miscellaneous  — 

An  OutUne  for  the  Study  of  Current  Political,  Economic,  and    Social  Problems. 

15  cents. 
♦Readings  in  Indiana  History.     Cloth:  70  cents. 
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Indiana  University  Studies 


Ma<laiiic    D'Aihlay  s    IMaci    in  llic    Dcvclopiiiciil    of   llic    l';n^,'lisli    Novel.       U.\     Will     I" 

Male.  I'h.l).      lT)  cents. 
Now   Species  of  Fossils  from    the    reiinsyK  aiiian   and    I'ertnian    KocUs  of    Kansas  and 

Oklahoma.      By  .losluia  \V.   IJeede.   IMi.l).      2r>  cents. 
Wasliiiifiton  Irvinj-'s  Fiction  in  the  Lijjhl  of  French  Criticism.       IJy  Ceoine  I).   .Morris. 

I'h.l).      125  cents. 
Report  on  tlie  Lakes  of  l  he  Tippecanoi'  Masin  (Indianai.       I5y    Will    Scot  1 .   I'll. I).      25 

cents. 
A  Study  of  Stale  Super-vision  and  .\dniinistral  ion  of  ( "haril  ies.      |{y   l<'rederic  11.  (iuild, 

A.M.      25  cents. 
Studies  in  .\rit  liinelic        Uy  Melvin  K.   llaKKcrly.   Fill).      25  cents. 
The    Ability    lo    Ucad :      Us    Measurement    and    Some    Factors   Conditioning    U.      I5y 

Melvin  K.  lla^'f,'erty .   I'll  I).      (In  press.) 
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